2024-09-17T04:24:11.911 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T04:24:11.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T04:24:12.032 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908543 branch: wip-pdonnell-testing-20240916.200549-debug description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} email: pdonnell@redhat.com first_in_suite: false job_id: '7908543' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240916.200549-debug ceph: cephfs: max_mds: 3 session_timeout: 300 cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_shutdown_timeout: 120 global: ms die on skipped message: false mds: mds oft prefetch dirfrags: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - overall HEALTH_ - \(MON_DOWN\) sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240916.200549-debug sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 476 sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf sleep_before_teardown: 0 subset: 320/512 suite: fs suite_branch: wip-pdonnell-testing-20240916.200549-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGPauQUNEcuKU6bDtbD1c4ZlApBG6Rp7Cjr3yxDsf9rYZkG3qNL5rTPfDKUg93USrAzPLFHY3TRQ2oG8PbsxNgk= smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEvz3g6JQjo/xiFovJV7JJvxhnmAg48WRLE+a11YoMzDLVtJbmn3uQPmcvTFcHFgan+xsSq6I/eZoXtNWEkXFsU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - fs/misc/trivial_sync.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_02:09:51 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T04:24:12.032 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa; will attempt to use it 2024-09-17T04:24:12.033 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks 2024-09-17T04:24:12.033 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T04:24:12.034 INFO:teuthology.task.internal:Checking packages... 2024-09-17T04:24:12.055 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf' 2024-09-17T04:24:12.055 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T04:24:12.056 INFO:teuthology.packaging:ref: None 2024-09-17T04:24:12.056 INFO:teuthology.packaging:tag: None 2024-09-17T04:24:12.056 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240916.200549-debug 2024-09-17T04:24:12.056 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:24:12.056 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240916.200549-debug 2024-09-17T04:24:12.190 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4989.gce1b342b 2024-09-17T04:24:12.192 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T04:24:12.198 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T04:24:12.198 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T04:24:12.227 INFO:teuthology.task.internal:Saving configuration 2024-09-17T04:24:12.246 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T04:24:12.253 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T04:24:12.277 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908543', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 04:19:13.938731', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGPauQUNEcuKU6bDtbD1c4ZlApBG6Rp7Cjr3yxDsf9rYZkG3qNL5rTPfDKUg93USrAzPLFHY3TRQ2oG8PbsxNgk='} 2024-09-17T04:24:12.297 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908543', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 04:19:13.936702', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEvz3g6JQjo/xiFovJV7JJvxhnmAg48WRLE+a11YoMzDLVtJbmn3uQPmcvTFcHFgan+xsSq6I/eZoXtNWEkXFsU='} 2024-09-17T04:24:12.297 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T04:24:12.303 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-17T04:24:12.303 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-09-17T04:24:12.303 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T04:24:12.415 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcb9c10bac0>, signals=[15]) 2024-09-17T04:24:12.416 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T04:24:12.422 INFO:teuthology.task.internal:Opening connections... 2024-09-17T04:24:12.422 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T04:24:12.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:24:12.523 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-09-17T04:24:12.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:24:12.600 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T04:24:12.605 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-09-17T04:24:12.623 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-09-17T04:24:12.624 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-09-17T04:24:12.681 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2024-09-17T04:24:12.681 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2024-09-17T04:24:12.681 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2024-09-17T04:24:12.682 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2024-09-17T04:24:12.682 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2024-09-17T04:24:12.682 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2024-09-17T04:24:12.682 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T04:24:12.682 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-09-17T04:24:12.682 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2024-09-17T04:24:12.682 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T04:24:12.682 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2024-09-17T04:24:12.682 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T04:24:12.682 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T04:24:12.682 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T04:24:12.683 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-09-17T04:24:12.708 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-09-17T04:24:12.726 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-09-17T04:24:12.726 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-09-17T04:24:12.783 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2024-09-17T04:24:12.784 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2024-09-17T04:24:12.784 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2024-09-17T04:24:12.784 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2024-09-17T04:24:12.784 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2024-09-17T04:24:12.784 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2024-09-17T04:24:12.784 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T04:24:12.784 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2024-09-17T04:24:12.784 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2024-09-17T04:24:12.784 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T04:24:12.784 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2024-09-17T04:24:12.784 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T04:24:12.784 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T04:24:12.784 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T04:24:12.785 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-09-17T04:24:12.808 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T04:24:12.816 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T04:24:12.835 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T04:24:12.836 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2024-09-17T04:24:12.838 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-09-17T04:24:12.855 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T04:24:12.860 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T04:24:12.860 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2024-09-17T04:24:12.895 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-09-17T04:24:12.920 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T04:24:12.973 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T04:24:12.987 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-17T04:24:12.988 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-17T04:24:12.988 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-17T04:24:12.988 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T04:24:13.005 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:24:13.005 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-09-17T04:24:13.063 INFO:teuthology.orchestra.run.smithi043.stdout:5.14.0-503.el9.x86_64 2024-09-17T04:24:13.063 INFO:teuthology.task.kernel:Running kernel on smithi043: 5.14.0-503.el9.x86_64 2024-09-17T04:24:13.063 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum install -y kernel 2024-09-17T04:24:17.512 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.3 MB 00:02 2024-09-17T04:24:19.565 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-17T04:24:25.522 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.5 MB 00:02 2024-09-17T04:24:27.089 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-17T04:24:28.252 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-17T04:24:33.808 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-17T04:24:35.773 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T04:24:35.773 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T04:24:35.868 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-17T04:24:35.873 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-17T04:24:35.873 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2024-09-17T04:24:35.873 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-17T04:24:35.873 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-17T04:24:35.873 INFO:teuthology.orchestra.run.smithi043.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T04:24:35.873 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-09-17T04:24:35.873 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T04:24:35.873 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T04:24:35.873 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T04:24:35.874 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:24:35.874 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-17T04:24:35.874 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-17T04:24:35.874 INFO:teuthology.orchestra.run.smithi043.stdout:Install 4 Packages 2024-09-17T04:24:35.874 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:24:35.874 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 79 M 2024-09-17T04:24:35.874 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 126 M 2024-09-17T04:24:35.874 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-17T04:24:36.460 INFO:teuthology.orchestra.run.smithi043.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 64 kB/s | 36 kB 00:00 2024-09-17T04:24:37.293 INFO:teuthology.orchestra.run.smithi043.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-17T04:24:37.935 INFO:teuthology.orchestra.run.smithi043.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-17T04:24:38.618 INFO:teuthology.orchestra.run.smithi043.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-17T04:24:38.619 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:24:38.619 INFO:teuthology.orchestra.run.smithi043.stdout:Total 29 MB/s | 79 MB 00:02 2024-09-17T04:24:39.329 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-17T04:24:39.686 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-17T04:24:39.686 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-17T04:24:40.675 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-17T04:24:40.675 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-17T04:24:43.244 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-17T04:24:43.923 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T04:24:44.013 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:24:46.771 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:24:46.897 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:24:52.017 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:24:52.056 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:24:57.198 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:25:35.936 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:25:35.977 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:25:36.341 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:25:36.341 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T04:25:36.341 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:25:36.341 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:25:37.210 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:25:37.210 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:25:37.211 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-17T04:25:37.211 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T04:25:37.211 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T04:25:37.211 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T04:25:37.211 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T04:25:37.211 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:25:37.211 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-17T04:25:37.611 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T04:25:37.706 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T04:25:37.706 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T04:25:37.707 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T04:25:37.707 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T04:25:37.707 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T04:25:37.707 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-17T04:25:37.707 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi043.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T04:25:37.707 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T04:25:37.766 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T04:25:37.766 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T04:25:37.767 DEBUG:teuthology.orchestra.run.smithi043:> sudo rpm -qi grub2-tools 2024-09-17T04:25:37.805 INFO:teuthology.orchestra.run.smithi043.stdout:Name : grub2-tools 2024-09-17T04:25:37.805 INFO:teuthology.orchestra.run.smithi043.stdout:Epoch : 1 2024-09-17T04:25:37.805 INFO:teuthology.orchestra.run.smithi043.stdout:Version : 2.06 2024-09-17T04:25:37.805 INFO:teuthology.orchestra.run.smithi043.stdout:Release : 82.el9 2024-09-17T04:25:37.806 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: x86_64 2024-09-17T04:25:37.806 INFO:teuthology.orchestra.run.smithi043.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T04:25:37.806 INFO:teuthology.orchestra.run.smithi043.stdout:Group : Unspecified 2024-09-17T04:25:37.806 INFO:teuthology.orchestra.run.smithi043.stdout:Size : 8274670 2024-09-17T04:25:37.806 INFO:teuthology.orchestra.run.smithi043.stdout:License : GPLv3+ 2024-09-17T04:25:37.806 INFO:teuthology.orchestra.run.smithi043.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T04:25:37.806 INFO:teuthology.orchestra.run.smithi043.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T04:25:37.806 INFO:teuthology.orchestra.run.smithi043.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T04:25:37.806 INFO:teuthology.orchestra.run.smithi043.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T04:25:37.806 INFO:teuthology.orchestra.run.smithi043.stdout:Packager : builder@centos.org 2024-09-17T04:25:37.806 INFO:teuthology.orchestra.run.smithi043.stdout:Vendor : CentOS 2024-09-17T04:25:37.806 INFO:teuthology.orchestra.run.smithi043.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T04:25:37.806 INFO:teuthology.orchestra.run.smithi043.stdout:Summary : Support tools for GRUB. 2024-09-17T04:25:37.807 INFO:teuthology.orchestra.run.smithi043.stdout:Description : 2024-09-17T04:25:37.807 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:25:37.807 INFO:teuthology.orchestra.run.smithi043.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T04:25:37.807 INFO:teuthology.orchestra.run.smithi043.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T04:25:37.807 INFO:teuthology.orchestra.run.smithi043.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T04:25:37.807 INFO:teuthology.orchestra.run.smithi043.stdout:hardware devices. 2024-09-17T04:25:37.807 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:25:37.807 INFO:teuthology.orchestra.run.smithi043.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T04:25:37.808 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T04:25:37.808 INFO:teuthology.task.kernel:Updating grub on smithi043 to boot 5.14.0-508.el9.x86_64 2024-09-17T04:25:37.808 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T04:25:38.396 INFO:teuthology.orchestra.run.smithi043.stderr:Generating grub configuration file ... 2024-09-17T04:25:39.669 INFO:teuthology.orchestra.run.smithi043.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T04:25:39.701 INFO:teuthology.orchestra.run.smithi043.stderr:done 2024-09-17T04:25:39.703 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-09-17T04:25:39.719 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.ymKnGuy6FS 2024-09-17T04:25:39.719 DEBUG:teuthology.orchestra.run.smithi043:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ymKnGuy6FS 2024-09-17T04:25:39.798 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.ymKnGuy6FS 2024-09-17T04:25:39.938 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.ymKnGuy6FS is 6KB 2024-09-17T04:25:39.989 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.ymKnGuy6FS 2024-09-17T04:25:40.003 DEBUG:teuthology.orchestra.run.smithi043:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T04:25:40.065 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T04:25:40.065 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T04:25:40.065 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T04:25:40.065 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T04:25:40.067 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T04:25:40.214 DEBUG:teuthology.orchestra.run.smithi043:> sudo shutdown -r now 2024-09-17T04:26:10.217 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-17T04:26:10.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-17T04:26:10.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:26:28.541 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-09-17T04:26:37.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-17T04:26:37.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:26:40.609 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-09-17T04:26:52.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-17T04:26:52.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:27:24.708 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-09-17T04:27:25.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-17T04:27:25.343 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-17T04:27:25.344 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-09-17T04:27:25.359 INFO:teuthology.orchestra.run.smithi043.stdout:5.14.0-508.el9.x86_64 2024-09-17T04:27:25.359 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T04:27:25.359 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T04:27:25.359 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T04:27:26.361 DEBUG:teuthology.parallel:result is None 2024-09-17T04:27:26.361 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T04:27:26.368 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T04:27:26.368 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T04:27:26.371 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T04:27:26.390 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T04:27:26.397 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T04:27:26.436 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T04:27:26.437 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T04:27:26.439 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T04:27:26.471 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T04:27:26.477 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T04:27:26.478 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T04:27:26.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:27:26.523 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T04:27:26.526 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T04:27:26.598 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T04:27:26.623 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T04:27:26.630 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T04:27:26.638 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T04:27:26.640 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T04:27:26.647 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T04:27:26.647 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T04:27:26.649 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T04:27:26.677 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T04:27:26.687 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T04:27:26.687 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T04:27:26.720 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T04:27:26.736 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T04:27:26.821 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T04:27:26.870 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T04:27:26.954 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T04:27:26.997 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:27:26.997 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T04:27:27.064 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T04:27:27.109 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T04:27:27.165 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T04:27:27.250 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T04:27:27.292 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:27:27.293 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T04:27:27.360 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2024-09-17T04:27:27.365 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-09-17T04:27:27.404 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T04:27:27.439 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T04:27:27.889 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T04:27:27.898 INFO:teuthology.task.internal:Starting timer... 2024-09-17T04:27:27.898 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T04:27:27.948 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T04:27:27.988 DEBUG:teuthology.orchestra.run.smithi043:> sudo service auditd rotate 2024-09-17T04:27:28.036 INFO:teuthology.orchestra.run.smithi043.stdout:Rotating logs: 2024-09-17T04:27:28.037 DEBUG:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2024-09-17T04:27:28.098 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: 2024-09-17T04:27:28.101 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T04:27:28.101 DEBUG:teuthology.orchestra.run.smithi043:> /usr/sbin/getenforce 2024-09-17T04:27:28.138 INFO:teuthology.orchestra.run.smithi043.stdout:Permissive 2024-09-17T04:27:28.138 DEBUG:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2024-09-17T04:27:28.160 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2024-09-17T04:27:28.160 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi043.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi062.front.sepia.ceph.com': 'permissive'} 2024-09-17T04:27:28.160 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T04:27:28.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:27:28.208 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T04:27:28.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:27:28.236 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T04:27:28.236 DEBUG:teuthology.orchestra.run.smithi043:> sudo /usr/sbin/setenforce permissive 2024-09-17T04:27:28.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2024-09-17T04:27:28.316 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T04:27:28.328 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-17T04:27:28.331 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-17T04:27:28.445 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T04:27:28.456 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T04:27:28.457 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi043.front.sepia.ceph.com,smithi062.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T04:31:38.828 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi043.front.sepia.ceph.com'), Remote(name='ubuntu@smithi062.front.sepia.ceph.com')] 2024-09-17T04:31:38.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-17T04:31:38.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:31:38.913 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-09-17T04:31:38.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-17T04:31:38.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-17T04:31:38.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:31:39.068 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-09-17T04:31:39.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-17T04:31:39.144 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T04:31:39.155 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T04:31:39.155 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T04:31:39.156 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T04:31:39.158 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T04:31:39.158 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T04:31:39.187 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T04:31:39.202 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T04:31:39.213 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T04:31:39.226 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T04:31:39.227 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: ntpd: command not found 2024-09-17T04:31:39.238 INFO:teuthology.orchestra.run.smithi043.stdout:506 Cannot talk to daemon 2024-09-17T04:31:39.250 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: ntpd: command not found 2024-09-17T04:31:39.253 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T04:31:39.261 INFO:teuthology.orchestra.run.smithi062.stdout:506 Cannot talk to daemon 2024-09-17T04:31:39.269 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T04:31:39.276 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T04:31:39.290 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T04:31:39.330 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-09-17T04:31:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T04:31:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-09-17T04:31:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:31:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:31:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:31:39.333 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:31:39.348 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-09-17T04:31:39.352 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T04:31:39.352 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-09-17T04:31:39.352 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:31:39.352 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:31:39.352 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:31:39.353 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:31:39.353 INFO:teuthology.run_tasks:Running task install... 2024-09-17T04:31:39.361 DEBUG:teuthology.task.install:project ceph 2024-09-17T04:31:39.361 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}} 2024-09-17T04:31:39.362 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'} 2024-09-17T04:31:39.362 INFO:teuthology.task.install:Using flavor: default 2024-09-17T04:31:39.367 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T04:31:39.367 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-17T04:31:39.368 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T04:31:39.368 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:31:39.370 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T04:31:39.370 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:31:39.519 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T04:31:39.519 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T04:31:39.523 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T04:31:39.523 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T04:31:39.629 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T04:31:39.629 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:31:39.629 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T04:31:39.639 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T04:31:39.639 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:31:39.639 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T04:31:39.656 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T04:31:39.656 DEBUG:teuthology.orchestra.run.smithi043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T04:31:39.665 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T04:31:39.665 DEBUG:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T04:31:39.723 DEBUG:teuthology.orchestra.run.smithi043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T04:31:39.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T04:31:39.800 DEBUG:teuthology.orchestra.run.smithi043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T04:31:39.806 DEBUG:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T04:31:39.865 INFO:teuthology.orchestra.run.smithi043.stdout:check_obsoletes = 1 2024-09-17T04:31:39.867 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum clean all 2024-09-17T04:31:39.870 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2024-09-17T04:31:39.871 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum clean all 2024-09-17T04:31:40.101 INFO:teuthology.orchestra.run.smithi062.stdout:45 files removed 2024-09-17T04:31:40.105 INFO:teuthology.orchestra.run.smithi043.stdout:45 files removed 2024-09-17T04:31:40.129 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T04:31:40.133 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T04:31:40.683 INFO:teuthology.orchestra.run.smithi062.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-17T04:31:40.716 INFO:teuthology.orchestra.run.smithi043.stdout:ceph packages for x86_64 298 kB/s | 84 kB 00:00 2024-09-17T04:31:40.975 INFO:teuthology.orchestra.run.smithi062.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-17T04:31:41.016 INFO:teuthology.orchestra.run.smithi043.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-17T04:31:41.251 INFO:teuthology.orchestra.run.smithi062.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-17T04:31:41.300 INFO:teuthology.orchestra.run.smithi043.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-17T04:31:42.228 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 9.3 MB/s | 8.3 MB 00:00 2024-09-17T04:31:43.193 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.3 MB 00:01 2024-09-17T04:31:48.677 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 4.7 MB/s | 20 MB 00:04 2024-09-17T04:31:54.594 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.5 MB 00:01 2024-09-17T04:31:56.211 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 19 kB 00:00 2024-09-17T04:31:57.182 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-17T04:31:57.392 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 1.5 MB/s | 20 MB 00:14 2024-09-17T04:32:02.738 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-17T04:32:04.051 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.5 MB 00:02 2024-09-17T04:32:04.958 INFO:teuthology.orchestra.run.smithi062.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T04:32:04.958 INFO:teuthology.orchestra.run.smithi062.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T04:32:04.970 INFO:teuthology.orchestra.run.smithi062.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T04:32:04.971 INFO:teuthology.orchestra.run.smithi062.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T04:32:04.972 INFO:teuthology.orchestra.run.smithi062.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T04:32:04.973 INFO:teuthology.orchestra.run.smithi062.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T04:32:04.975 INFO:teuthology.orchestra.run.smithi062.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T04:32:04.977 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T04:32:04.978 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T04:32:05.044 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-09-17T04:32:05.063 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-09-17T04:32:05.063 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-09-17T04:32:05.063 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-09-17T04:32:05.064 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-09-17T04:32:05.064 INFO:teuthology.orchestra.run.smithi062.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T04:32:05.064 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T04:32:05.064 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T04:32:05.064 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T04:32:05.064 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T04:32:05.064 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T04:32:05.064 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T04:32:05.064 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T04:32:05.065 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T04:32:05.065 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T04:32:05.065 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T04:32:05.065 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T04:32:05.065 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T04:32:05.065 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T04:32:05.065 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T04:32:05.065 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T04:32:05.066 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T04:32:05.066 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T04:32:05.066 INFO:teuthology.orchestra.run.smithi062.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T04:32:05.066 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T04:32:05.066 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T04:32:05.066 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T04:32:05.066 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T04:32:05.066 INFO:teuthology.orchestra.run.smithi062.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T04:32:05.066 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T04:32:05.066 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T04:32:05.067 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T04:32:05.067 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T04:32:05.067 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T04:32:05.067 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T04:32:05.067 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T04:32:05.067 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T04:32:05.067 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T04:32:05.067 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T04:32:05.067 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T04:32:05.067 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T04:32:05.068 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T04:32:05.068 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2024-09-17T04:32:05.068 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T04:32:05.068 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T04:32:05.068 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T04:32:05.068 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T04:32:05.068 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T04:32:05.068 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T04:32:05.068 INFO:teuthology.orchestra.run.smithi062.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T04:32:05.069 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T04:32:05.069 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-09-17T04:32:05.069 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T04:32:05.069 INFO:teuthology.orchestra.run.smithi062.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T04:32:05.069 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T04:32:05.069 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T04:32:05.069 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T04:32:05.069 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T04:32:05.069 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T04:32:05.069 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T04:32:05.070 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T04:32:05.070 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T04:32:05.070 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T04:32:05.070 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T04:32:05.070 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T04:32:05.070 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T04:32:05.070 INFO:teuthology.orchestra.run.smithi062.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T04:32:05.070 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T04:32:05.070 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T04:32:05.070 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T04:32:05.071 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T04:32:05.071 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T04:32:05.071 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T04:32:05.071 INFO:teuthology.orchestra.run.smithi062.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T04:32:05.071 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T04:32:05.071 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T04:32:05.071 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T04:32:05.071 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T04:32:05.071 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T04:32:05.072 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T04:32:05.072 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T04:32:05.072 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T04:32:05.072 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T04:32:05.072 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T04:32:05.072 INFO:teuthology.orchestra.run.smithi062.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T04:32:05.072 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T04:32:05.072 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T04:32:05.072 INFO:teuthology.orchestra.run.smithi062.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T04:32:05.072 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T04:32:05.072 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T04:32:05.072 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T04:32:05.072 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T04:32:05.073 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T04:32:05.073 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T04:32:05.073 INFO:teuthology.orchestra.run.smithi062.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T04:32:05.073 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T04:32:05.073 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T04:32:05.073 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T04:32:05.074 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T04:32:05.074 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T04:32:05.074 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T04:32:05.074 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T04:32:05.074 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T04:32:05.074 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T04:32:05.074 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T04:32:05.074 INFO:teuthology.orchestra.run.smithi062.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T04:32:05.074 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T04:32:05.074 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T04:32:05.074 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T04:32:05.074 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T04:32:05.075 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T04:32:05.075 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T04:32:05.075 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T04:32:05.075 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T04:32:05.075 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T04:32:05.075 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T04:32:05.075 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T04:32:05.075 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T04:32:05.075 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T04:32:05.075 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T04:32:05.075 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T04:32:05.075 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T04:32:05.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T04:32:05.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T04:32:05.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T04:32:05.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T04:32:05.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T04:32:05.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T04:32:05.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T04:32:05.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T04:32:05.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T04:32:05.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T04:32:05.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T04:32:05.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T04:32:05.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T04:32:05.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T04:32:05.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T04:32:05.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T04:32:05.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T04:32:05.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T04:32:05.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T04:32:05.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T04:32:05.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T04:32:05.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T04:32:05.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T04:32:05.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T04:32:05.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T04:32:05.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T04:32:05.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T04:32:05.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T04:32:05.078 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T04:32:05.078 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T04:32:05.078 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T04:32:05.078 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T04:32:05.078 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T04:32:05.078 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T04:32:05.078 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T04:32:05.078 INFO:teuthology.orchestra.run.smithi062.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T04:32:05.078 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T04:32:05.078 INFO:teuthology.orchestra.run.smithi062.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T04:32:05.078 INFO:teuthology.orchestra.run.smithi062.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T04:32:05.078 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T04:32:05.078 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T04:32:05.078 INFO:teuthology.orchestra.run.smithi062.stdout:Installing weak dependencies: 2024-09-17T04:32:05.079 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T04:32:05.079 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:32:05.079 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-09-17T04:32:05.079 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-09-17T04:32:05.079 INFO:teuthology.orchestra.run.smithi062.stdout:Install 149 Packages 2024-09-17T04:32:05.079 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 8 Packages 2024-09-17T04:32:05.079 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:32:05.079 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 228 M 2024-09-17T04:32:05.080 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-09-17T04:32:05.740 INFO:teuthology.orchestra.run.smithi062.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 52 kB/s | 6.6 kB 00:00 2024-09-17T04:32:05.868 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 19 kB 00:00 2024-09-17T04:32:05.915 INFO:teuthology.orchestra.run.smithi062.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 4.9 MB/s | 873 kB 00:00 2024-09-17T04:32:05.982 INFO:teuthology.orchestra.run.smithi062.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 2.2 MB/s | 148 kB 00:00 2024-09-17T04:32:06.224 INFO:teuthology.orchestra.run.smithi062.stdout:(4/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 9.0 MB/s | 5.5 MB 00:00 2024-09-17T04:32:06.282 INFO:teuthology.orchestra.run.smithi062.stdout:(5/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 7.6 MB/s | 2.3 MB 00:00 2024-09-17T04:32:06.341 INFO:teuthology.orchestra.run.smithi062.stdout:(6/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 13 MB/s | 1.5 MB 00:00 2024-09-17T04:32:06.691 INFO:teuthology.orchestra.run.smithi062.stdout:(7/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 12 MB/s | 5.0 MB 00:00 2024-09-17T04:32:06.756 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-17T04:32:06.892 INFO:teuthology.orchestra.run.smithi062.stdout:(8/157): ceph-common-19.3.0-4989.gce1b342b.el9. 16 MB/s | 20 MB 00:01 2024-09-17T04:32:06.942 INFO:teuthology.orchestra.run.smithi062.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 504 kB/s | 25 kB 00:00 2024-09-17T04:32:07.375 INFO:teuthology.orchestra.run.smithi062.stdout:(10/157): ceph-radosgw-19.3.0-4989.gce1b342b.el 15 MB/s | 10 MB 00:00 2024-09-17T04:32:07.559 INFO:teuthology.orchestra.run.smithi062.stdout:(11/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 15 MB/s | 18 MB 00:01 2024-09-17T04:32:07.584 INFO:teuthology.orchestra.run.smithi062.stdout:(12/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 1.1 MB/s | 225 kB 00:00 2024-09-17T04:32:07.601 INFO:teuthology.orchestra.run.smithi062.stdout:(13/157): cephfs-shell-19.3.0-4989.gce1b342b.el 648 kB/s | 27 kB 00:00 2024-09-17T04:32:07.618 INFO:teuthology.orchestra.run.smithi062.stdout:(14/157): libcephfs-devel-19.3.0-4989.gce1b342b 944 kB/s | 32 kB 00:00 2024-09-17T04:32:07.651 INFO:teuthology.orchestra.run.smithi062.stdout:(15/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 15 MB/s | 766 kB 00:00 2024-09-17T04:32:07.677 INFO:teuthology.orchestra.run.smithi062.stdout:(16/157): libcephsqlite-19.3.0-4989.gce1b342b.e 2.6 MB/s | 159 kB 00:00 2024-09-17T04:32:07.727 INFO:teuthology.orchestra.run.smithi062.stdout:(17/157): librados-devel-19.3.0-4989.gce1b342b. 1.6 MB/s | 127 kB 00:00 2024-09-17T04:32:07.761 INFO:teuthology.orchestra.run.smithi062.stdout:(18/157): libradosstriper1-19.3.0-4989.gce1b342 5.9 MB/s | 507 kB 00:00 2024-09-17T04:32:07.819 INFO:teuthology.orchestra.run.smithi062.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 775 kB/s | 45 kB 00:00 2024-09-17T04:32:07.894 INFO:teuthology.orchestra.run.smithi062.stdout:(20/157): python3-ceph-common-19.3.0-4989.gce1b 1.9 MB/s | 143 kB 00:00 2024-09-17T04:32:07.962 INFO:teuthology.orchestra.run.smithi062.stdout:(21/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 23 MB/s | 5.3 MB 00:00 2024-09-17T04:32:07.987 INFO:teuthology.orchestra.run.smithi062.stdout:(22/157): python3-cephfs-19.3.0-4989.gce1b342b. 1.7 MB/s | 162 kB 00:00 2024-09-17T04:32:08.012 INFO:teuthology.orchestra.run.smithi062.stdout:(23/157): python3-rados-19.3.0-4989.gce1b342b.e 6.3 MB/s | 321 kB 00:00 2024-09-17T04:32:08.055 INFO:teuthology.orchestra.run.smithi062.stdout:(24/157): python3-rbd-19.3.0-4989.gce1b342b.el9 4.4 MB/s | 305 kB 00:00 2024-09-17T04:32:08.072 INFO:teuthology.orchestra.run.smithi062.stdout:(25/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.6 MB/s | 99 kB 00:00 2024-09-17T04:32:08.113 INFO:teuthology.orchestra.run.smithi062.stdout:(26/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-17T04:32:08.189 INFO:teuthology.orchestra.run.smithi062.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 2.2 MB/s | 170 kB 00:00 2024-09-17T04:32:08.239 INFO:teuthology.orchestra.run.smithi062.stdout:(28/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 19 MB/s | 3.1 MB 00:00 2024-09-17T04:32:08.264 INFO:teuthology.orchestra.run.smithi062.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4989.g 454 kB/s | 34 kB 00:00 2024-09-17T04:32:08.298 INFO:teuthology.orchestra.run.smithi062.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 2.6 MB/s | 154 kB 00:00 2024-09-17T04:32:08.748 INFO:teuthology.orchestra.run.smithi062.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 16 MB/s | 7.4 MB 00:00 2024-09-17T04:32:08.807 INFO:teuthology.orchestra.run.smithi062.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 4.9 MB/s | 291 kB 00:00 2024-09-17T04:32:09.157 INFO:teuthology.orchestra.run.smithi062.stdout:(33/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 18 MB/s | 40 MB 00:02 2024-09-17T04:32:09.183 INFO:teuthology.orchestra.run.smithi062.stdout:(34/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 131 kB/s | 49 kB 00:00 2024-09-17T04:32:09.208 INFO:teuthology.orchestra.run.smithi062.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4989.gc 328 kB/s | 16 kB 00:00 2024-09-17T04:32:09.234 INFO:teuthology.orchestra.run.smithi062.stdout:(36/157): ceph-volume-19.3.0-4989.gce1b342b.el9 5.6 MB/s | 285 kB 00:00 2024-09-17T04:32:09.392 INFO:teuthology.orchestra.run.smithi062.stdout:(37/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 13 MB/s | 14 MB 00:01 2024-09-17T04:32:09.417 INFO:teuthology.orchestra.run.smithi062.stdout:(38/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 99 kB/s | 18 kB 00:00 2024-09-17T04:32:09.442 INFO:teuthology.orchestra.run.smithi062.stdout:(39/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 3.3 MB/s | 784 kB 00:00 2024-09-17T04:32:09.593 INFO:teuthology.orchestra.run.smithi062.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 399 kB/s | 80 kB 00:00 2024-09-17T04:32:09.647 INFO:teuthology.orchestra.run.smithi062.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 955 kB/s | 191 kB 00:00 2024-09-17T04:32:09.701 INFO:teuthology.orchestra.run.smithi062.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-17T04:32:09.743 INFO:teuthology.orchestra.run.smithi062.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-17T04:32:09.761 INFO:teuthology.orchestra.run.smithi062.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-17T04:32:09.794 INFO:teuthology.orchestra.run.smithi062.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-17T04:32:09.819 INFO:teuthology.orchestra.run.smithi062.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-17T04:32:09.853 INFO:teuthology.orchestra.run.smithi062.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-17T04:32:09.886 INFO:teuthology.orchestra.run.smithi062.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 5.0 MB/s | 1.2 MB 00:00 2024-09-17T04:32:10.345 INFO:teuthology.orchestra.run.smithi062.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 233 kB/s | 107 kB 00:00 2024-09-17T04:32:10.453 INFO:teuthology.orchestra.run.smithi062.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-17T04:32:10.648 INFO:teuthology.orchestra.run.smithi062.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 832 kB/s | 689 kB 00:00 2024-09-17T04:32:10.688 INFO:teuthology.orchestra.run.smithi062.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-17T04:32:10.763 INFO:teuthology.orchestra.run.smithi062.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 285 kB/s | 33 kB 00:00 2024-09-17T04:32:10.846 INFO:teuthology.orchestra.run.smithi062.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 799 kB/s | 313 kB 00:00 2024-09-17T04:32:10.871 INFO:teuthology.orchestra.run.smithi062.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-17T04:32:10.983 INFO:teuthology.orchestra.run.smithi062.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 82 kB/s | 11 kB 00:00 2024-09-17T04:32:11.014 INFO:teuthology.orchestra.run.smithi062.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.2 MB/s | 171 kB 00:00 2024-09-17T04:32:11.097 INFO:teuthology.orchestra.run.smithi062.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-17T04:32:11.122 INFO:teuthology.orchestra.run.smithi062.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-17T04:32:11.198 INFO:teuthology.orchestra.run.smithi062.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.9 MB/s | 3.0 MB 00:00 2024-09-17T04:32:11.307 INFO:teuthology.orchestra.run.smithi062.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 226 kB/s | 24 kB 00:00 2024-09-17T04:32:11.332 INFO:teuthology.orchestra.run.smithi062.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-09-17T04:32:11.390 INFO:teuthology.orchestra.run.smithi062.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-17T04:32:11.415 INFO:teuthology.orchestra.run.smithi062.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-17T04:32:11.449 INFO:teuthology.orchestra.run.smithi062.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-17T04:32:11.500 INFO:teuthology.orchestra.run.smithi062.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-17T04:32:11.525 INFO:teuthology.orchestra.run.smithi062.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 352 kB/s | 38 kB 00:00 2024-09-17T04:32:11.667 INFO:teuthology.orchestra.run.smithi062.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-17T04:32:11.792 INFO:teuthology.orchestra.run.smithi062.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-17T04:32:12.092 INFO:teuthology.orchestra.run.smithi062.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 458 kB/s | 137 kB 00:00 2024-09-17T04:32:12.578 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-17T04:32:13.126 INFO:teuthology.orchestra.run.smithi062.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.7 MB/s | 4.4 MB 00:01 2024-09-17T04:32:14.643 INFO:teuthology.orchestra.run.smithi062.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 681 kB/s | 1.0 MB 00:01 2024-09-17T04:32:14.843 INFO:teuthology.orchestra.run.smithi062.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 437 kB/s | 87 kB 00:00 2024-09-17T04:32:14.890 INFO:teuthology.orchestra.run.smithi043.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T04:32:14.890 INFO:teuthology.orchestra.run.smithi043.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T04:32:14.902 INFO:teuthology.orchestra.run.smithi043.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T04:32:14.903 INFO:teuthology.orchestra.run.smithi043.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T04:32:14.904 INFO:teuthology.orchestra.run.smithi043.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T04:32:14.905 INFO:teuthology.orchestra.run.smithi043.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T04:32:14.907 INFO:teuthology.orchestra.run.smithi043.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T04:32:14.909 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T04:32:14.910 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T04:32:14.978 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-17T04:32:14.994 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-09-17T04:32:14.995 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-09-17T04:32:14.995 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-09-17T04:32:14.995 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-17T04:32:14.995 INFO:teuthology.orchestra.run.smithi043.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T04:32:14.995 INFO:teuthology.orchestra.run.smithi043.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T04:32:14.995 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T04:32:14.995 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T04:32:14.995 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T04:32:14.995 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T04:32:14.996 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T04:32:14.996 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T04:32:14.996 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T04:32:14.996 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T04:32:14.996 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T04:32:14.996 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T04:32:14.996 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T04:32:14.996 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T04:32:14.996 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T04:32:14.996 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T04:32:14.996 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T04:32:14.997 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T04:32:14.997 INFO:teuthology.orchestra.run.smithi043.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T04:32:14.997 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T04:32:14.997 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T04:32:14.997 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T04:32:14.997 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T04:32:14.997 INFO:teuthology.orchestra.run.smithi043.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T04:32:14.997 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T04:32:14.997 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T04:32:14.997 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T04:32:14.998 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T04:32:14.998 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T04:32:14.998 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T04:32:14.998 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T04:32:14.998 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T04:32:14.999 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T04:32:14.999 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T04:32:14.999 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T04:32:14.999 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T04:32:14.999 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T04:32:14.999 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2024-09-17T04:32:14.999 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T04:32:14.999 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T04:32:14.999 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T04:32:14.999 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T04:32:14.999 INFO:teuthology.orchestra.run.smithi043.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T04:32:15.000 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T04:32:15.000 INFO:teuthology.orchestra.run.smithi043.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T04:32:15.000 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T04:32:15.000 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-09-17T04:32:15.000 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T04:32:15.000 INFO:teuthology.orchestra.run.smithi043.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T04:32:15.000 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T04:32:15.000 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T04:32:15.000 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T04:32:15.000 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T04:32:15.000 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T04:32:15.000 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T04:32:15.001 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T04:32:15.001 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T04:32:15.001 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T04:32:15.001 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T04:32:15.001 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T04:32:15.001 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T04:32:15.001 INFO:teuthology.orchestra.run.smithi043.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T04:32:15.001 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T04:32:15.001 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T04:32:15.001 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T04:32:15.001 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T04:32:15.001 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T04:32:15.002 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T04:32:15.002 INFO:teuthology.orchestra.run.smithi043.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T04:32:15.002 INFO:teuthology.orchestra.run.smithi043.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T04:32:15.002 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T04:32:15.002 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T04:32:15.002 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T04:32:15.002 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T04:32:15.002 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T04:32:15.002 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T04:32:15.002 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T04:32:15.002 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T04:32:15.002 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T04:32:15.002 INFO:teuthology.orchestra.run.smithi043.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T04:32:15.003 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T04:32:15.003 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T04:32:15.003 INFO:teuthology.orchestra.run.smithi043.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T04:32:15.003 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T04:32:15.003 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T04:32:15.003 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T04:32:15.003 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T04:32:15.003 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T04:32:15.003 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T04:32:15.003 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T04:32:15.003 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T04:32:15.003 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T04:32:15.003 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T04:32:15.004 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T04:32:15.004 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T04:32:15.004 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T04:32:15.004 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T04:32:15.004 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T04:32:15.004 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T04:32:15.004 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T04:32:15.004 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T04:32:15.004 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T04:32:15.004 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T04:32:15.004 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T04:32:15.004 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T04:32:15.005 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T04:32:15.005 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T04:32:15.005 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T04:32:15.005 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T04:32:15.005 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T04:32:15.005 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T04:32:15.005 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T04:32:15.005 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T04:32:15.005 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T04:32:15.005 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T04:32:15.005 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T04:32:15.005 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T04:32:15.005 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T04:32:15.006 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T04:32:15.006 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T04:32:15.006 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T04:32:15.006 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T04:32:15.006 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T04:32:15.006 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T04:32:15.006 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T04:32:15.006 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T04:32:15.006 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T04:32:15.006 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T04:32:15.006 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T04:32:15.006 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T04:32:15.007 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T04:32:15.007 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T04:32:15.007 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T04:32:15.007 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T04:32:15.007 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T04:32:15.007 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T04:32:15.007 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T04:32:15.007 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T04:32:15.007 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T04:32:15.007 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T04:32:15.007 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T04:32:15.007 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T04:32:15.007 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T04:32:15.007 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T04:32:15.008 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T04:32:15.008 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T04:32:15.008 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T04:32:15.008 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T04:32:15.008 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T04:32:15.008 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T04:32:15.008 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T04:32:15.008 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T04:32:15.008 INFO:teuthology.orchestra.run.smithi043.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T04:32:15.008 INFO:teuthology.orchestra.run.smithi043.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T04:32:15.008 INFO:teuthology.orchestra.run.smithi043.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T04:32:15.008 INFO:teuthology.orchestra.run.smithi043.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T04:32:15.008 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T04:32:15.009 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T04:32:15.009 INFO:teuthology.orchestra.run.smithi043.stdout:Installing weak dependencies: 2024-09-17T04:32:15.009 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T04:32:15.009 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:32:15.009 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-17T04:32:15.009 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-09-17T04:32:15.009 INFO:teuthology.orchestra.run.smithi043.stdout:Install 149 Packages 2024-09-17T04:32:15.009 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 8 Packages 2024-09-17T04:32:15.009 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:32:15.010 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 228 M 2024-09-17T04:32:15.010 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-17T04:32:15.410 INFO:teuthology.orchestra.run.smithi062.stdout:(74/157): openblas-openmp-0.3.26-2.el9.x86_64.r 1.2 MB/s | 4.9 MB 00:03 2024-09-17T04:32:15.518 INFO:teuthology.orchestra.run.smithi062.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 566 kB/s | 61 kB 00:00 2024-09-17T04:32:15.894 INFO:teuthology.orchestra.run.smithi062.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 652 kB/s | 245 kB 00:00 2024-09-17T04:32:15.913 INFO:teuthology.orchestra.run.smithi043.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 47 kB/s | 6.6 kB 00:00 2024-09-17T04:32:15.969 INFO:teuthology.orchestra.run.smithi062.stdout:(77/157): postgresql-server-13.16-1.el9.x86_64. 1.5 MB/s | 5.8 MB 00:03 2024-09-17T04:32:16.094 INFO:teuthology.orchestra.run.smithi062.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 205 kB/s | 26 kB 00:00 2024-09-17T04:32:16.105 INFO:teuthology.orchestra.run.smithi043.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 4.4 MB/s | 873 kB 00:00 2024-09-17T04:32:16.172 INFO:teuthology.orchestra.run.smithi043.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 2.2 MB/s | 148 kB 00:00 2024-09-17T04:32:16.203 INFO:teuthology.orchestra.run.smithi062.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-09-17T04:32:16.314 INFO:teuthology.orchestra.run.smithi043.stdout:(4/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-17T04:32:16.336 INFO:teuthology.orchestra.run.smithi062.stdout:(80/157): python3-jinja2-2.11.3-6.el9.noarch.rp 561 kB/s | 248 kB 00:00 2024-09-17T04:32:16.372 INFO:teuthology.orchestra.run.smithi043.stdout:(5/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 11 MB/s | 2.3 MB 00:00 2024-09-17T04:32:16.445 INFO:teuthology.orchestra.run.smithi062.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 321 kB/s | 35 kB 00:00 2024-09-17T04:32:16.464 INFO:teuthology.orchestra.run.smithi043.stdout:(6/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 10 MB/s | 1.5 MB 00:00 2024-09-17T04:32:16.529 INFO:teuthology.orchestra.run.smithi062.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 529 kB/s | 172 kB 00:00 2024-09-17T04:32:16.756 INFO:teuthology.orchestra.run.smithi043.stdout:(7/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 13 MB/s | 5.0 MB 00:00 2024-09-17T04:32:16.904 INFO:teuthology.orchestra.run.smithi062.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 668 kB/s | 250 kB 00:00 2024-09-17T04:32:16.990 INFO:teuthology.orchestra.run.smithi043.stdout:(8/157): ceph-common-19.3.0-4989.gce1b342b.el9. 16 MB/s | 20 MB 00:01 2024-09-17T04:32:17.032 INFO:teuthology.orchestra.run.smithi043.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 608 kB/s | 25 kB 00:00 2024-09-17T04:32:17.287 INFO:teuthology.orchestra.run.smithi062.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 580 kB/s | 222 kB 00:00 2024-09-17T04:32:17.503 INFO:teuthology.orchestra.run.smithi062.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 358 kB/s | 77 kB 00:00 2024-09-17T04:32:17.549 INFO:teuthology.orchestra.run.smithi043.stdout:(10/157): ceph-radosgw-19.3.0-4989.gce1b342b.el 13 MB/s | 10 MB 00:00 2024-09-17T04:32:17.613 INFO:teuthology.orchestra.run.smithi062.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 386 kB/s | 42 kB 00:00 2024-09-17T04:32:17.733 INFO:teuthology.orchestra.run.smithi043.stdout:(11/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 14 MB/s | 18 MB 00:01 2024-09-17T04:32:17.758 INFO:teuthology.orchestra.run.smithi043.stdout:(12/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 1.1 MB/s | 225 kB 00:00 2024-09-17T04:32:17.783 INFO:teuthology.orchestra.run.smithi043.stdout:(13/157): cephfs-shell-19.3.0-4989.gce1b342b.el 540 kB/s | 27 kB 00:00 2024-09-17T04:32:17.809 INFO:teuthology.orchestra.run.smithi043.stdout:(14/157): libcephfs-devel-19.3.0-4989.gce1b342b 633 kB/s | 32 kB 00:00 2024-09-17T04:32:17.842 INFO:teuthology.orchestra.run.smithi043.stdout:(15/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 13 MB/s | 766 kB 00:00 2024-09-17T04:32:17.867 INFO:teuthology.orchestra.run.smithi043.stdout:(16/157): libcephsqlite-19.3.0-4989.gce1b342b.e 2.6 MB/s | 159 kB 00:00 2024-09-17T04:32:17.892 INFO:teuthology.orchestra.run.smithi043.stdout:(17/157): librados-devel-19.3.0-4989.gce1b342b. 2.5 MB/s | 127 kB 00:00 2024-09-17T04:32:17.926 INFO:teuthology.orchestra.run.smithi043.stdout:(18/157): libradosstriper1-19.3.0-4989.gce1b342 8.5 MB/s | 507 kB 00:00 2024-09-17T04:32:17.985 INFO:teuthology.orchestra.run.smithi043.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 773 kB/s | 45 kB 00:00 2024-09-17T04:32:18.077 INFO:teuthology.orchestra.run.smithi043.stdout:(20/157): python3-ceph-common-19.3.0-4989.gce1b 1.5 MB/s | 143 kB 00:00 2024-09-17T04:32:18.079 INFO:teuthology.orchestra.run.smithi062.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 577 kB/s | 269 kB 00:00 2024-09-17T04:32:18.160 INFO:teuthology.orchestra.run.smithi043.stdout:(21/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 20 MB/s | 5.3 MB 00:00 2024-09-17T04:32:18.194 INFO:teuthology.orchestra.run.smithi043.stdout:(22/157): python3-cephfs-19.3.0-4989.gce1b342b. 1.4 MB/s | 162 kB 00:00 2024-09-17T04:32:18.219 INFO:teuthology.orchestra.run.smithi043.stdout:(23/157): python3-rados-19.3.0-4989.gce1b342b.e 5.4 MB/s | 321 kB 00:00 2024-09-17T04:32:18.253 INFO:teuthology.orchestra.run.smithi043.stdout:(24/157): python3-rbd-19.3.0-4989.gce1b342b.el9 5.1 MB/s | 305 kB 00:00 2024-09-17T04:32:18.278 INFO:teuthology.orchestra.run.smithi043.stdout:(25/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.7 MB/s | 99 kB 00:00 2024-09-17T04:32:18.303 INFO:teuthology.orchestra.run.smithi043.stdout:(26/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-17T04:32:18.362 INFO:teuthology.orchestra.run.smithi043.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 2.9 MB/s | 170 kB 00:00 2024-09-17T04:32:18.363 INFO:teuthology.orchestra.run.smithi062.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 560 kB/s | 159 kB 00:00 2024-09-17T04:32:18.420 INFO:teuthology.orchestra.run.smithi043.stdout:(28/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 22 MB/s | 3.1 MB 00:00 2024-09-17T04:32:18.445 INFO:teuthology.orchestra.run.smithi043.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4989.g 410 kB/s | 34 kB 00:00 2024-09-17T04:32:18.471 INFO:teuthology.orchestra.run.smithi043.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 3.0 MB/s | 154 kB 00:00 2024-09-17T04:32:18.830 INFO:teuthology.orchestra.run.smithi062.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 598 kB/s | 279 kB 00:00 2024-09-17T04:32:18.930 INFO:teuthology.orchestra.run.smithi043.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 16 MB/s | 7.4 MB 00:00 2024-09-17T04:32:18.939 INFO:teuthology.orchestra.run.smithi062.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 470 kB/s | 51 kB 00:00 2024-09-17T04:32:18.997 INFO:teuthology.orchestra.run.smithi043.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 4.3 MB/s | 291 kB 00:00 2024-09-17T04:32:19.039 INFO:teuthology.orchestra.run.smithi062.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 536 kB/s | 54 kB 00:00 2024-09-17T04:32:19.064 INFO:teuthology.orchestra.run.smithi043.stdout:(33/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 739 kB/s | 49 kB 00:00 2024-09-17T04:32:19.106 INFO:teuthology.orchestra.run.smithi062.stdout:(92/157): python3-babel-2.9.1-2.el9.noarch.rpm 1.4 MB/s | 6.0 MB 00:04 2024-09-17T04:32:19.131 INFO:teuthology.orchestra.run.smithi043.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4989.gc 247 kB/s | 16 kB 00:00 2024-09-17T04:32:19.206 INFO:teuthology.orchestra.run.smithi062.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-09-17T04:32:19.281 INFO:teuthology.orchestra.run.smithi043.stdout:(35/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 17 MB/s | 14 MB 00:00 2024-09-17T04:32:19.306 INFO:teuthology.orchestra.run.smithi043.stdout:(36/157): ceph-volume-19.3.0-4989.gce1b342b.el9 1.6 MB/s | 285 kB 00:00 2024-09-17T04:32:19.307 INFO:teuthology.orchestra.run.smithi062.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 442 kB/s | 44 kB 00:00 2024-09-17T04:32:19.340 INFO:teuthology.orchestra.run.smithi043.stdout:(37/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 13 MB/s | 784 kB 00:00 2024-09-17T04:32:19.357 INFO:teuthology.orchestra.run.smithi043.stdout:(38/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 364 kB/s | 18 kB 00:00 2024-09-17T04:32:19.682 INFO:teuthology.orchestra.run.smithi062.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 588 kB/s | 221 kB 00:00 2024-09-17T04:32:19.715 INFO:teuthology.orchestra.run.smithi043.stdout:(39/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 15 MB/s | 40 MB 00:02 2024-09-17T04:32:19.782 INFO:teuthology.orchestra.run.smithi062.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 359 kB/s | 36 kB 00:00 2024-09-17T04:32:19.783 INFO:teuthology.orchestra.run.smithi043.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 180 kB/s | 80 kB 00:00 2024-09-17T04:32:19.849 INFO:teuthology.orchestra.run.smithi043.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-17T04:32:19.882 INFO:teuthology.orchestra.run.smithi062.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-09-17T04:32:19.899 INFO:teuthology.orchestra.run.smithi043.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-17T04:32:19.933 INFO:teuthology.orchestra.run.smithi043.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 801 kB 00:00 2024-09-17T04:32:19.958 INFO:teuthology.orchestra.run.smithi043.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-17T04:32:19.992 INFO:teuthology.orchestra.run.smithi043.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-17T04:32:20.062 INFO:teuthology.orchestra.run.smithi043.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-17T04:32:20.118 INFO:teuthology.orchestra.run.smithi043.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-09-17T04:32:20.159 INFO:teuthology.orchestra.run.smithi043.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 4.0 MB/s | 1.2 MB 00:00 2024-09-17T04:32:20.285 INFO:teuthology.orchestra.run.smithi043.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-17T04:32:20.310 INFO:teuthology.orchestra.run.smithi043.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 711 kB/s | 107 kB 00:00 2024-09-17T04:32:20.335 INFO:teuthology.orchestra.run.smithi043.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-17T04:32:20.349 INFO:teuthology.orchestra.run.smithi062.stdout:(98/157): socat-1.7.4.1-6.el9.x86_64.rpm 652 kB/s | 304 kB 00:00 2024-09-17T04:32:20.369 INFO:teuthology.orchestra.run.smithi043.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-09-17T04:32:20.394 INFO:teuthology.orchestra.run.smithi043.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-17T04:32:20.420 INFO:teuthology.orchestra.run.smithi043.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-17T04:32:20.445 INFO:teuthology.orchestra.run.smithi043.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-17T04:32:20.458 INFO:teuthology.orchestra.run.smithi062.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 533 kB/s | 58 kB 00:00 2024-09-17T04:32:20.486 INFO:teuthology.orchestra.run.smithi043.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 169 kB/s | 11 kB 00:00 2024-09-17T04:32:20.512 INFO:teuthology.orchestra.run.smithi043.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-17T04:32:20.537 INFO:teuthology.orchestra.run.smithi043.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-17T04:32:20.562 INFO:teuthology.orchestra.run.smithi043.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-09-17T04:32:20.630 INFO:teuthology.orchestra.run.smithi043.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-17T04:32:20.655 INFO:teuthology.orchestra.run.smithi043.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-17T04:32:20.658 INFO:teuthology.orchestra.run.smithi062.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 479 kB/s | 96 kB 00:00 2024-09-17T04:32:20.689 INFO:teuthology.orchestra.run.smithi043.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-17T04:32:20.714 INFO:teuthology.orchestra.run.smithi043.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 806 kB/s | 47 kB 00:00 2024-09-17T04:32:20.739 INFO:teuthology.orchestra.run.smithi043.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-17T04:32:20.773 INFO:teuthology.orchestra.run.smithi043.stdout:(65/157): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-09-17T04:32:20.798 INFO:teuthology.orchestra.run.smithi043.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 660 kB/s | 38 kB 00:00 2024-09-17T04:32:20.823 INFO:teuthology.orchestra.run.smithi043.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-17T04:32:20.867 INFO:teuthology.orchestra.run.smithi062.stdout:(101/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 305 kB/s | 64 kB 00:00 2024-09-17T04:32:20.915 INFO:teuthology.orchestra.run.smithi043.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-17T04:32:20.966 INFO:teuthology.orchestra.run.smithi043.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-17T04:32:20.992 INFO:teuthology.orchestra.run.smithi062.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 358 kB/s | 45 kB 00:00 2024-09-17T04:32:20.999 INFO:teuthology.orchestra.run.smithi043.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-17T04:32:21.024 INFO:teuthology.orchestra.run.smithi043.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-17T04:32:21.084 INFO:teuthology.orchestra.run.smithi062.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 244 kB/s | 22 kB 00:00 2024-09-17T04:32:21.092 INFO:teuthology.orchestra.run.smithi043.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-09-17T04:32:21.133 INFO:teuthology.orchestra.run.smithi043.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-17T04:32:21.159 INFO:teuthology.orchestra.run.smithi043.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-17T04:32:21.201 INFO:teuthology.orchestra.run.smithi043.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-17T04:32:21.276 INFO:teuthology.orchestra.run.smithi043.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-09-17T04:32:21.301 INFO:teuthology.orchestra.run.smithi043.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-17T04:32:21.326 INFO:teuthology.orchestra.run.smithi062.stdout:(104/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-09-17T04:32:21.326 INFO:teuthology.orchestra.run.smithi043.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-17T04:32:21.351 INFO:teuthology.orchestra.run.smithi043.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-09-17T04:32:21.377 INFO:teuthology.orchestra.run.smithi043.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-17T04:32:21.402 INFO:teuthology.orchestra.run.smithi043.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-17T04:32:21.427 INFO:teuthology.orchestra.run.smithi043.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-09-17T04:32:21.469 INFO:teuthology.orchestra.run.smithi062.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 3.8 MB/s | 548 kB 00:00 2024-09-17T04:32:21.510 INFO:teuthology.orchestra.run.smithi062.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 7.4 MB/s | 308 kB 00:00 2024-09-17T04:32:21.511 INFO:teuthology.orchestra.run.smithi043.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-17T04:32:21.535 INFO:teuthology.orchestra.run.smithi062.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-17T04:32:21.536 INFO:teuthology.orchestra.run.smithi043.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-17T04:32:21.562 INFO:teuthology.orchestra.run.smithi043.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-17T04:32:21.587 INFO:teuthology.orchestra.run.smithi043.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-17T04:32:21.612 INFO:teuthology.orchestra.run.smithi043.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 846 kB/s | 42 kB 00:00 2024-09-17T04:32:21.637 INFO:teuthology.orchestra.run.smithi043.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-17T04:32:21.663 INFO:teuthology.orchestra.run.smithi043.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-17T04:32:21.688 INFO:teuthology.orchestra.run.smithi043.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-17T04:32:21.713 INFO:teuthology.orchestra.run.smithi043.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-17T04:32:21.747 INFO:teuthology.orchestra.run.smithi043.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 911 kB/s | 54 kB 00:00 2024-09-17T04:32:21.785 INFO:teuthology.orchestra.run.smithi062.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-17T04:32:21.810 INFO:teuthology.orchestra.run.smithi062.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-17T04:32:21.822 INFO:teuthology.orchestra.run.smithi043.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-17T04:32:21.836 INFO:teuthology.orchestra.run.smithi062.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-17T04:32:21.847 INFO:teuthology.orchestra.run.smithi043.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-09-17T04:32:21.861 INFO:teuthology.orchestra.run.smithi062.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-17T04:32:21.873 INFO:teuthology.orchestra.run.smithi043.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-17T04:32:21.886 INFO:teuthology.orchestra.run.smithi062.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-17T04:32:21.907 INFO:teuthology.orchestra.run.smithi043.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-17T04:32:21.928 INFO:teuthology.orchestra.run.smithi062.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-17T04:32:21.932 INFO:teuthology.orchestra.run.smithi043.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-17T04:32:21.957 INFO:teuthology.orchestra.run.smithi043.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-17T04:32:21.970 INFO:teuthology.orchestra.run.smithi062.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-17T04:32:21.982 INFO:teuthology.orchestra.run.smithi043.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-17T04:32:21.996 INFO:teuthology.orchestra.run.smithi062.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-17T04:32:22.007 INFO:teuthology.orchestra.run.smithi043.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-17T04:32:22.021 INFO:teuthology.orchestra.run.smithi062.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-17T04:32:22.033 INFO:teuthology.orchestra.run.smithi043.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-17T04:32:22.046 INFO:teuthology.orchestra.run.smithi062.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-09-17T04:32:22.058 INFO:teuthology.orchestra.run.smithi043.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-17T04:32:22.080 INFO:teuthology.orchestra.run.smithi062.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-17T04:32:22.083 INFO:teuthology.orchestra.run.smithi043.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-17T04:32:22.113 INFO:teuthology.orchestra.run.smithi062.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-17T04:32:22.138 INFO:teuthology.orchestra.run.smithi062.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 12 MB/s | 303 kB 00:00 2024-09-17T04:32:22.164 INFO:teuthology.orchestra.run.smithi062.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-17T04:32:22.239 INFO:teuthology.orchestra.run.smithi062.stdout:(122/157): python3-grpcio-1.46.7-10.el9.x86_64. 27 MB/s | 2.0 MB 00:00 2024-09-17T04:32:22.264 INFO:teuthology.orchestra.run.smithi062.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-17T04:32:22.290 INFO:teuthology.orchestra.run.smithi062.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-17T04:32:22.315 INFO:teuthology.orchestra.run.smithi062.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 702 kB/s | 18 kB 00:00 2024-09-17T04:32:22.325 INFO:teuthology.orchestra.run.smithi043.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-17T04:32:22.341 INFO:teuthology.orchestra.run.smithi062.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 923 kB/s | 23 kB 00:00 2024-09-17T04:32:22.350 INFO:teuthology.orchestra.run.smithi043.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 76 kB/s | 22 kB 00:00 2024-09-17T04:32:22.366 INFO:teuthology.orchestra.run.smithi062.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-17T04:32:22.391 INFO:teuthology.orchestra.run.smithi062.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-09-17T04:32:22.434 INFO:teuthology.orchestra.run.smithi043.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 3.6 MB/s | 308 kB 00:00 2024-09-17T04:32:22.449 INFO:teuthology.orchestra.run.smithi062.stdout:(129/157): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-17T04:32:22.468 INFO:teuthology.orchestra.run.smithi043.stdout:(107/157): abseil-cpp-20211102.0-3.el9.x86_64.r 3.8 MB/s | 548 kB 00:00 2024-09-17T04:32:22.475 INFO:teuthology.orchestra.run.smithi062.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-17T04:32:22.493 INFO:teuthology.orchestra.run.smithi043.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 333 kB/s | 19 kB 00:00 2024-09-17T04:32:22.500 INFO:teuthology.orchestra.run.smithi062.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-17T04:32:22.518 INFO:teuthology.orchestra.run.smithi043.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-17T04:32:22.533 INFO:teuthology.orchestra.run.smithi062.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-17T04:32:22.543 INFO:teuthology.orchestra.run.smithi043.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-17T04:32:22.559 INFO:teuthology.orchestra.run.smithi062.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-17T04:32:22.577 INFO:teuthology.orchestra.run.smithi043.stdout:(111/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-09-17T04:32:22.584 INFO:teuthology.orchestra.run.smithi062.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-09-17T04:32:22.610 INFO:teuthology.orchestra.run.smithi062.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-17T04:32:22.611 INFO:teuthology.orchestra.run.smithi043.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-09-17T04:32:22.626 INFO:teuthology.orchestra.run.smithi062.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-09-17T04:32:22.643 INFO:teuthology.orchestra.run.smithi062.stdout:(137/157): python3-repoze-lru-0.7-16.el9.noarch 1.8 MB/s | 31 kB 00:00 2024-09-17T04:32:22.653 INFO:teuthology.orchestra.run.smithi043.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-09-17T04:32:22.677 INFO:teuthology.orchestra.run.smithi062.stdout:(138/157): python3-routes-2.5.1-5.el9.noarch.rp 5.5 MB/s | 188 kB 00:00 2024-09-17T04:32:22.694 INFO:teuthology.orchestra.run.smithi062.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-17T04:32:22.703 INFO:teuthology.orchestra.run.smithi043.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 839 kB 00:00 2024-09-17T04:32:22.710 INFO:teuthology.orchestra.run.smithi062.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 2.1 MB/s | 36 kB 00:00 2024-09-17T04:32:22.720 INFO:teuthology.orchestra.run.smithi043.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-17T04:32:22.727 INFO:teuthology.orchestra.run.smithi062.stdout:(141/157): python3-typing-extensions-4.12.2-2.e 4.4 MB/s | 74 kB 00:00 2024-09-17T04:32:22.746 INFO:teuthology.orchestra.run.smithi043.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-09-17T04:32:22.753 INFO:teuthology.orchestra.run.smithi062.stdout:(142/157): python3-webob-1.8.8-2.el9.noarch.rpm 9.0 MB/s | 230 kB 00:00 2024-09-17T04:32:22.770 INFO:teuthology.orchestra.run.smithi043.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-17T04:32:22.778 INFO:teuthology.orchestra.run.smithi062.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-17T04:32:22.796 INFO:teuthology.orchestra.run.smithi043.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-17T04:32:22.812 INFO:teuthology.orchestra.run.smithi062.stdout:(144/157): python3-werkzeug-2.0.3-3.el9.1.noarc 13 MB/s | 427 kB 00:00 2024-09-17T04:32:22.821 INFO:teuthology.orchestra.run.smithi043.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-17T04:32:22.837 INFO:teuthology.orchestra.run.smithi062.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 806 kB/s | 20 kB 00:00 2024-09-17T04:32:22.854 INFO:teuthology.orchestra.run.smithi043.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-17T04:32:22.862 INFO:teuthology.orchestra.run.smithi062.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-17T04:32:22.880 INFO:teuthology.orchestra.run.smithi043.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-17T04:32:22.914 INFO:teuthology.orchestra.run.smithi043.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-17T04:32:22.946 INFO:teuthology.orchestra.run.smithi062.stdout:(147/157): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-17T04:32:22.947 INFO:teuthology.orchestra.run.smithi043.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-17T04:32:22.973 INFO:teuthology.orchestra.run.smithi043.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-17T04:32:22.998 INFO:teuthology.orchestra.run.smithi043.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-17T04:32:23.023 INFO:teuthology.orchestra.run.smithi043.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-17T04:32:23.048 INFO:teuthology.orchestra.run.smithi043.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-17T04:32:23.074 INFO:teuthology.orchestra.run.smithi043.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 785 kB/s | 20 kB 00:00 2024-09-17T04:32:23.141 INFO:teuthology.orchestra.run.smithi043.stdout:(129/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.6 MB/s | 4.4 MB 00:00 2024-09-17T04:32:23.196 INFO:teuthology.orchestra.run.smithi062.stdout:(148/157): librados2-19.3.0-4989.gce1b342b.el9. 14 MB/s | 3.4 MB 00:00 2024-09-17T04:32:23.199 INFO:teuthology.orchestra.run.smithi043.stdout:(130/157): python3-grpcio-1.46.7-10.el9.x86_64. 6.4 MB/s | 2.0 MB 00:00 2024-09-17T04:32:23.225 INFO:teuthology.orchestra.run.smithi043.stdout:(131/157): python3-logutils-0.3.5-21.el9.noarch 555 kB/s | 46 kB 00:00 2024-09-17T04:32:23.250 INFO:teuthology.orchestra.run.smithi043.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-17T04:32:23.275 INFO:teuthology.orchestra.run.smithi043.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-17T04:32:23.300 INFO:teuthology.orchestra.run.smithi043.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-17T04:32:23.313 INFO:teuthology.orchestra.run.smithi062.stdout:(149/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 27 MB/s | 3.2 MB 00:00 2024-09-17T04:32:23.326 INFO:teuthology.orchestra.run.smithi043.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-17T04:32:23.351 INFO:teuthology.orchestra.run.smithi043.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-17T04:32:23.376 INFO:teuthology.orchestra.run.smithi043.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-17T04:32:23.401 INFO:teuthology.orchestra.run.smithi043.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-17T04:32:23.427 INFO:teuthology.orchestra.run.smithi043.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-17T04:32:23.460 INFO:teuthology.orchestra.run.smithi043.stdout:(140/157): python3-kubernetes-26.1.0-2.el9.noar 2.6 MB/s | 1.0 MB 00:00 2024-09-17T04:32:23.486 INFO:teuthology.orchestra.run.smithi043.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-09-17T04:32:23.511 INFO:teuthology.orchestra.run.smithi043.stdout:(142/157): python3-tempora-5.0.0-2.el9.noarch.r 428 kB/s | 36 kB 00:00 2024-09-17T04:32:23.536 INFO:teuthology.orchestra.run.smithi043.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-17T04:32:23.562 INFO:teuthology.orchestra.run.smithi043.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-17T04:32:23.587 INFO:teuthology.orchestra.run.smithi043.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-17T04:32:23.612 INFO:teuthology.orchestra.run.smithi043.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-17T04:32:23.646 INFO:teuthology.orchestra.run.smithi043.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-17T04:32:23.671 INFO:teuthology.orchestra.run.smithi043.stdout:(148/157): re2-20211101-20.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-17T04:32:23.754 INFO:teuthology.orchestra.run.smithi043.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-17T04:32:23.863 INFO:teuthology.orchestra.run.smithi062.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 4.2 MB/s | 2.3 MB 00:00 2024-09-17T04:32:23.913 INFO:teuthology.orchestra.run.smithi043.stdout:(150/157): librados2-19.3.0-4989.gce1b342b.el9. 13 MB/s | 3.4 MB 00:00 2024-09-17T04:32:23.963 INFO:teuthology.orchestra.run.smithi043.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-09-17T04:32:24.005 INFO:teuthology.orchestra.run.smithi043.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 982 kB/s | 41 kB 00:00 2024-09-17T04:32:24.047 INFO:teuthology.orchestra.run.smithi043.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 5.8 MB/s | 249 kB 00:00 2024-09-17T04:32:24.090 INFO:teuthology.orchestra.run.smithi043.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 10 MB/s | 1.8 MB 00:00 2024-09-17T04:32:24.105 INFO:teuthology.orchestra.run.smithi062.stdout:(151/157): python3-numpy-1.20.1-5.el9.x86_64.rp 681 kB/s | 5.1 MB 00:07 2024-09-17T04:32:24.132 INFO:teuthology.orchestra.run.smithi043.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-17T04:32:24.190 INFO:teuthology.orchestra.run.smithi043.stdout:(156/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 6.1 MB/s | 3.2 MB 00:00 2024-09-17T04:32:24.247 INFO:teuthology.orchestra.run.smithi062.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 289 kB/s | 41 kB 00:00 2024-09-17T04:32:24.248 INFO:teuthology.orchestra.run.smithi043.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-09-17T04:32:24.254 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:32:24.254 INFO:teuthology.orchestra.run.smithi043.stdout:Total 25 MB/s | 228 MB 00:09 2024-09-17T04:32:24.406 INFO:teuthology.orchestra.run.smithi062.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.5 MB/s | 249 kB 00:00 2024-09-17T04:32:24.598 INFO:teuthology.orchestra.run.smithi062.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 7.1 MB/s | 1.4 MB 00:00 2024-09-17T04:32:24.956 INFO:teuthology.orchestra.run.smithi062.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 1.7 MB/s | 1.8 MB 00:01 2024-09-17T04:32:25.508 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-17T04:32:25.682 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-17T04:32:25.682 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-17T04:32:25.832 INFO:teuthology.orchestra.run.smithi062.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 2.4 MB 00:01 2024-09-17T04:32:28.081 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-17T04:32:28.081 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-17T04:32:34.806 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-17T04:32:34.928 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T04:32:34.969 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T04:32:35.029 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T04:32:35.062 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T04:32:35.087 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T04:32:35.137 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T04:32:35.499 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T04:32:35.629 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:32:35.750 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:32:35.781 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:32:35.881 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:32:35.910 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T04:32:35.940 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T04:32:36.122 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T04:32:36.183 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T04:32:36.219 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:32:36.318 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:32:36.353 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T04:32:36.408 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T04:32:36.429 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T04:32:36.451 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T04:32:36.607 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T04:32:36.785 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T04:32:36.944 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T04:32:37.045 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:32:37.129 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:32:37.379 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:32:37.489 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T04:32:37.516 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T04:32:37.552 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T04:32:37.629 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T04:32:37.688 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T04:32:37.728 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T04:32:37.770 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T04:32:37.803 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T04:32:37.838 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T04:32:37.910 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T04:32:37.970 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T04:32:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T04:32:38.052 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T04:32:38.131 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T04:32:38.162 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T04:32:38.206 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T04:32:38.234 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T04:32:38.308 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T04:32:38.350 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T04:32:38.436 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T04:32:38.585 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T04:32:38.646 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T04:32:39.217 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T04:32:39.309 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T04:32:39.352 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T04:32:39.395 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T04:32:39.433 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T04:32:39.476 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T04:32:39.649 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T04:32:39.703 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T04:32:39.799 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T04:32:39.868 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T04:32:39.942 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T04:32:39.981 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T04:32:40.015 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T04:32:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T04:32:40.098 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T04:32:40.142 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T04:32:40.184 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T04:32:40.337 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T04:32:40.377 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T04:32:40.419 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T04:32:40.528 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T04:32:40.831 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T04:32:40.893 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T04:32:40.934 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T04:32:40.967 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T04:32:41.317 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T04:32:41.459 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T04:32:41.502 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T04:32:41.531 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T04:32:41.565 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T04:32:41.605 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T04:32:41.644 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T04:32:41.674 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T04:32:41.708 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T04:32:41.741 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T04:32:41.784 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T04:32:41.820 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T04:32:41.918 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T04:32:41.974 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T04:32:42.004 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T04:32:42.140 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T04:32:42.198 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T04:32:42.982 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T04:32:43.027 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T04:32:43.061 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T04:32:43.168 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T04:32:43.214 INFO:teuthology.orchestra.run.smithi062.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 688 kB/s | 16 MB 00:24 2024-09-17T04:32:43.218 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:32:43.218 INFO:teuthology.orchestra.run.smithi062.stdout:Total 6.0 MB/s | 228 MB 00:38 2024-09-17T04:32:43.234 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T04:32:43.288 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T04:32:43.388 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T04:32:43.431 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T04:32:43.622 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T04:32:43.653 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T04:32:43.733 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T04:32:44.443 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T04:32:44.477 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-09-17T04:32:44.573 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T04:32:44.643 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-09-17T04:32:44.643 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-09-17T04:32:45.932 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T04:32:46.006 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T04:32:46.034 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T04:32:46.067 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T04:32:46.411 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T04:32:46.463 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T04:32:46.559 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-09-17T04:32:46.560 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-09-17T04:32:46.563 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T04:32:46.602 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T04:32:46.739 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T04:32:47.284 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T04:32:47.318 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T04:32:47.381 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T04:32:47.420 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T04:32:49.830 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:32:49.866 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:32:50.481 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:32:50.536 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T04:32:50.630 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T04:32:50.630 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T04:32:50.631 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T04:32:50.631 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:32:50.670 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T04:32:53.086 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-09-17T04:32:53.193 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T04:32:53.232 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T04:32:53.294 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T04:32:53.328 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T04:32:53.352 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T04:32:53.395 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T04:32:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T04:32:53.870 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:32:53.990 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:32:54.021 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:32:54.113 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:32:54.142 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T04:32:54.171 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T04:32:54.334 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T04:32:54.399 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T04:32:54.426 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:32:54.533 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:32:54.560 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T04:32:54.623 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T04:32:54.644 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T04:32:54.666 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T04:32:54.837 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T04:32:54.991 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T04:32:55.101 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T04:32:55.202 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:32:55.289 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:32:55.521 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:32:55.630 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T04:32:55.660 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T04:32:55.696 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T04:32:55.770 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T04:32:55.821 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T04:32:55.870 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T04:32:55.913 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T04:32:55.945 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T04:32:55.973 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T04:32:56.046 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T04:32:56.097 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T04:32:56.126 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T04:32:56.162 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T04:32:56.241 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T04:32:56.272 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T04:32:56.308 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T04:32:56.336 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T04:32:56.410 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T04:32:56.460 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T04:32:56.538 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T04:32:56.681 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T04:32:56.737 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T04:32:57.293 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T04:32:57.376 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T04:32:57.411 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T04:32:57.454 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T04:32:57.501 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T04:32:57.543 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T04:32:57.698 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T04:32:57.754 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T04:32:57.849 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T04:32:57.912 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T04:32:57.986 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T04:32:58.023 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T04:32:58.059 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T04:32:58.107 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T04:32:58.141 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T04:32:58.188 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T04:32:58.227 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T04:32:58.372 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T04:32:58.420 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T04:32:58.462 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T04:32:58.570 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T04:32:58.603 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T04:32:58.644 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T04:32:58.669 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T04:32:58.693 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T04:32:58.772 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T04:32:58.908 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T04:32:58.942 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T04:32:58.971 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T04:32:59.005 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T04:32:59.045 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T04:32:59.084 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T04:32:59.114 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T04:32:59.148 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T04:32:59.182 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T04:32:59.232 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T04:32:59.266 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T04:32:59.356 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T04:32:59.405 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T04:32:59.436 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T04:32:59.545 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T04:32:59.597 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T04:33:00.374 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T04:33:00.426 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T04:33:00.460 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T04:33:00.563 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T04:33:00.616 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T04:33:00.661 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T04:33:00.751 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T04:33:00.789 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T04:33:00.970 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T04:33:00.995 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T04:33:01.074 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T04:33:01.763 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T04:33:01.889 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T04:33:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T04:33:03.052 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /sys 2024-09-17T04:33:03.052 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /proc 2024-09-17T04:33:03.052 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /mnt 2024-09-17T04:33:03.052 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /var/tmp 2024-09-17T04:33:03.052 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /home 2024-09-17T04:33:03.052 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /root 2024-09-17T04:33:03.052 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /tmp 2024-09-17T04:33:03.052 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:03.185 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T04:33:03.231 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T04:33:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T04:33:03.248 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:03.248 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T04:33:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:03.265 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T04:33:03.293 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T04:33:03.326 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T04:33:03.668 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T04:33:03.714 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T04:33:03.789 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T04:33:03.819 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T04:33:03.855 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T04:33:04.383 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T04:33:04.484 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T04:33:04.788 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T04:33:04.869 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T04:33:04.909 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T04:33:04.937 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T04:33:04.937 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:04.937 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T04:33:04.937 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T04:33:04.937 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T04:33:04.937 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:05.184 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T04:33:05.209 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T04:33:05.209 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:05.209 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T04:33:05.209 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T04:33:05.209 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T04:33:05.209 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:05.719 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T04:33:05.744 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T04:33:05.744 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:05.744 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T04:33:05.744 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T04:33:05.744 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T04:33:05.745 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:05.849 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T04:33:05.907 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T04:33:05.972 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T04:33:06.171 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T04:33:06.220 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T04:33:06.302 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T04:33:06.401 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T04:33:06.553 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T04:33:06.612 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T04:33:06.652 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T04:33:06.682 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T04:33:07.144 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T04:33:07.169 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T04:33:07.198 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:33:07.211 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T04:33:07.231 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:33:07.279 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T04:33:07.318 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T04:33:07.832 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:33:07.868 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T04:33:07.962 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T04:33:07.962 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T04:33:07.962 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T04:33:07.962 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:07.994 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T04:33:10.733 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T04:33:10.790 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T04:33:11.806 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T04:33:11.832 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T04:33:11.956 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T04:33:12.132 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T04:33:12.167 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T04:33:12.193 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T04:33:12.193 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:12.193 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T04:33:12.193 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T04:33:12.193 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T04:33:12.193 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:12.243 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T04:33:12.255 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T04:33:12.358 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T04:33:12.419 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T04:33:13.444 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T04:33:13.479 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T04:33:13.503 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T04:33:13.504 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:13.504 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T04:33:13.504 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T04:33:13.504 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T04:33:13.504 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:13.546 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T04:33:13.570 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T04:33:13.571 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:13.571 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T04:33:13.571 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:13.621 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T04:33:13.646 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T04:33:13.646 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:13.647 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T04:33:13.647 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T04:33:13.647 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T04:33:13.647 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:13.981 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T04:33:14.006 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T04:33:14.006 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:14.006 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T04:33:14.006 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T04:33:14.006 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T04:33:14.007 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:18.244 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T04:33:18.285 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T04:33:18.335 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T04:33:18.374 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T04:33:18.402 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T04:33:18.614 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T04:33:18.673 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T04:33:18.703 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T04:33:18.733 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T04:33:18.779 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T04:33:19.463 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:33:19.502 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:33:19.523 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:33:20.349 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T04:33:20.349 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /sys 2024-09-17T04:33:20.349 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /proc 2024-09-17T04:33:20.349 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /mnt 2024-09-17T04:33:20.349 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /var/tmp 2024-09-17T04:33:20.349 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /home 2024-09-17T04:33:20.349 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /root 2024-09-17T04:33:20.350 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /tmp 2024-09-17T04:33:20.350 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:20.445 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T04:33:20.522 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T04:33:20.538 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T04:33:20.539 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:20.539 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T04:33:20.539 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:20.539 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T04:33:20.588 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T04:33:20.688 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T04:33:20.717 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T04:33:20.743 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T04:33:20.777 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T04:33:20.777 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T04:33:20.869 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T04:33:20.870 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T04:33:20.953 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T04:33:20.979 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T04:33:20.984 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:33:20.984 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:33:21.172 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:33:21.172 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T04:33:21.256 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T04:33:21.332 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:33:22.184 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T04:33:22.211 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T04:33:22.211 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:22.211 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T04:33:22.211 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T04:33:22.212 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T04:33:22.212 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:22.451 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T04:33:22.474 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T04:33:22.474 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:22.474 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T04:33:22.474 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T04:33:22.475 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T04:33:22.475 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:22.968 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T04:33:22.992 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T04:33:22.992 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:22.992 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T04:33:22.992 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T04:33:22.992 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T04:33:22.992 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:23.099 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T04:33:23.157 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T04:33:23.221 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T04:33:23.413 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T04:33:23.461 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T04:33:23.542 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T04:33:23.631 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T04:33:23.782 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T04:33:23.820 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T04:33:23.851 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T04:33:23.878 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T04:33:24.300 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T04:33:24.327 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T04:33:24.360 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T04:33:24.445 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T04:33:24.475 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T04:33:27.700 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:33:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T04:33:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T04:33:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T04:33:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T04:33:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T04:33:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T04:33:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T04:33:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:33:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:33:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T04:33:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T04:33:27.702 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T04:33:27.702 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T04:33:27.702 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:33:27.702 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T04:33:27.702 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T04:33:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T04:33:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T04:33:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T04:33:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T04:33:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T04:33:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T04:33:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T04:33:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T04:33:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T04:33:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T04:33:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T04:33:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T04:33:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T04:33:27.717 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T04:33:27.717 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T04:33:27.717 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T04:33:27.717 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T04:33:27.717 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T04:33:27.717 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T04:33:27.717 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T04:33:27.717 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T04:33:27.718 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T04:33:27.718 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T04:33:27.718 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T04:33:27.718 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T04:33:27.718 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T04:33:27.718 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T04:33:27.718 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T04:33:27.718 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T04:33:27.718 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T04:33:27.718 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T04:33:27.718 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T04:33:27.718 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T04:33:27.719 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T04:33:27.719 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T04:33:27.719 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T04:33:27.719 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T04:33:27.719 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T04:33:27.719 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T04:33:27.719 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T04:33:27.719 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T04:33:27.719 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T04:33:27.719 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T04:33:27.719 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T04:33:27.720 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T04:33:27.720 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T04:33:27.720 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T04:33:27.720 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T04:33:27.720 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T04:33:27.720 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T04:33:27.721 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T04:33:27.721 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T04:33:27.721 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T04:33:27.721 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T04:33:27.721 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T04:33:27.721 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T04:33:27.722 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T04:33:27.722 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T04:33:27.722 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T04:33:27.722 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T04:33:27.722 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T04:33:27.722 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T04:33:27.722 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T04:33:27.722 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T04:33:27.722 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T04:33:27.722 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T04:33:27.722 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T04:33:27.723 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T04:33:27.723 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T04:33:27.723 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T04:33:27.723 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T04:33:27.723 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T04:33:27.723 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T04:33:27.723 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T04:33:27.723 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T04:33:27.723 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T04:33:27.723 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T04:33:27.724 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T04:33:27.724 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T04:33:27.724 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T04:33:27.724 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T04:33:27.724 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T04:33:27.724 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T04:33:27.724 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T04:33:27.724 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T04:33:27.724 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T04:33:27.724 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T04:33:27.724 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T04:33:27.724 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T04:33:27.725 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T04:33:27.725 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T04:33:27.725 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T04:33:27.725 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T04:33:27.725 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T04:33:27.725 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T04:33:27.725 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T04:33:27.725 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T04:33:27.725 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T04:33:27.725 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T04:33:27.726 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T04:33:27.726 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T04:33:27.726 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T04:33:27.726 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T04:33:27.726 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T04:33:27.726 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T04:33:27.726 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T04:33:27.726 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T04:33:27.726 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T04:33:27.726 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T04:33:27.726 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T04:33:27.726 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T04:33:27.726 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T04:33:27.726 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T04:33:27.726 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T04:33:27.727 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T04:33:27.727 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T04:33:27.727 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T04:33:27.727 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T04:33:27.727 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T04:33:27.727 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T04:33:27.727 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T04:33:27.727 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T04:33:27.727 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T04:33:27.727 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T04:33:27.727 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T04:33:27.727 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T04:33:27.728 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T04:33:27.728 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T04:33:27.728 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T04:33:27.728 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T04:33:27.728 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T04:33:27.728 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T04:33:27.728 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T04:33:27.728 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T04:33:27.728 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T04:33:27.728 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T04:33:27.728 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T04:33:27.728 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T04:33:27.728 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T04:33:27.729 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T04:33:27.729 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T04:33:27.729 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T04:33:27.729 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T04:33:27.729 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T04:33:27.729 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T04:33:27.729 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T04:33:27.729 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T04:33:27.729 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T04:33:27.868 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T04:33:27.931 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T04:33:28.943 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T04:33:28.973 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T04:33:29.092 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T04:33:29.265 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T04:33:29.292 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T04:33:29.316 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T04:33:29.316 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:29.316 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T04:33:29.316 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T04:33:29.316 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T04:33:29.316 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:29.368 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T04:33:29.380 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T04:33:29.482 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T04:33:29.533 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T04:33:30.213 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:33:30.213 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:30.213 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2024-09-17T04:33:30.214 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T04:33:30.214 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T04:33:30.214 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T04:33:30.214 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T04:33:30.214 INFO:teuthology.orchestra.run.smithi043.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.214 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.214 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T04:33:30.214 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T04:33:30.214 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-17T04:33:30.214 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T04:33:30.214 INFO:teuthology.orchestra.run.smithi043.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T04:33:30.214 INFO:teuthology.orchestra.run.smithi043.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T04:33:30.215 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T04:33:30.215 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.215 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.215 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.215 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.215 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:30.215 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.215 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.215 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.215 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:30.215 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:30.215 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:30.215 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:30.216 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:30.216 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.216 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.216 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:30.216 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.216 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.216 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.216 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:30.216 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:30.216 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.216 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.217 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:30.217 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T04:33:30.217 INFO:teuthology.orchestra.run.smithi043.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T04:33:30.217 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T04:33:30.217 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T04:33:30.217 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T04:33:30.217 INFO:teuthology.orchestra.run.smithi043.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T04:33:30.217 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T04:33:30.217 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T04:33:30.217 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T04:33:30.217 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T04:33:30.217 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T04:33:30.217 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.218 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.218 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.218 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T04:33:30.218 INFO:teuthology.orchestra.run.smithi043.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T04:33:30.218 INFO:teuthology.orchestra.run.smithi043.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T04:33:30.218 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T04:33:30.219 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T04:33:30.219 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T04:33:30.219 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.219 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.219 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T04:33:30.219 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.219 INFO:teuthology.orchestra.run.smithi043.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T04:33:30.219 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T04:33:30.219 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T04:33:30.219 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T04:33:30.219 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T04:33:30.219 INFO:teuthology.orchestra.run.smithi043.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T04:33:30.220 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T04:33:30.220 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T04:33:30.220 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T04:33:30.220 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T04:33:30.220 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T04:33:30.220 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T04:33:30.220 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T04:33:30.220 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T04:33:30.220 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T04:33:30.220 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T04:33:30.220 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T04:33:30.220 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T04:33:30.220 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T04:33:30.221 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T04:33:30.221 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T04:33:30.221 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T04:33:30.221 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T04:33:30.221 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.221 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.221 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.221 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T04:33:30.221 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T04:33:30.221 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T04:33:30.221 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T04:33:30.221 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T04:33:30.222 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T04:33:30.222 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T04:33:30.222 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T04:33:30.222 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T04:33:30.222 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T04:33:30.222 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T04:33:30.222 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T04:33:30.222 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T04:33:30.222 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T04:33:30.222 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T04:33:30.222 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T04:33:30.222 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T04:33:30.223 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T04:33:30.223 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T04:33:30.223 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T04:33:30.223 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T04:33:30.223 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T04:33:30.223 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T04:33:30.223 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T04:33:30.223 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T04:33:30.223 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T04:33:30.223 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T04:33:30.223 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T04:33:30.223 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T04:33:30.223 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T04:33:30.224 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T04:33:30.224 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T04:33:30.224 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T04:33:30.224 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T04:33:30.224 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T04:33:30.224 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T04:33:30.224 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T04:33:30.224 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T04:33:30.224 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T04:33:30.224 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T04:33:30.224 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.224 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T04:33:30.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T04:33:30.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T04:33:30.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T04:33:30.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T04:33:30.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T04:33:30.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T04:33:30.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T04:33:30.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T04:33:30.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T04:33:30.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T04:33:30.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T04:33:30.226 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T04:33:30.226 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T04:33:30.226 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T04:33:30.226 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T04:33:30.226 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T04:33:30.226 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T04:33:30.226 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.226 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.226 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:30.226 INFO:teuthology.orchestra.run.smithi043.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T04:33:30.226 INFO:teuthology.orchestra.run.smithi043.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T04:33:30.226 INFO:teuthology.orchestra.run.smithi043.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T04:33:30.226 INFO:teuthology.orchestra.run.smithi043.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T04:33:30.227 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T04:33:30.227 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T04:33:30.227 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T04:33:30.227 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:30.227 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-17T04:33:30.550 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T04:33:30.587 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T04:33:30.610 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T04:33:30.610 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:30.610 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T04:33:30.611 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T04:33:30.611 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T04:33:30.611 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:30.654 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T04:33:30.680 DEBUG:teuthology.parallel:result is None 2024-09-17T04:33:30.681 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T04:33:30.681 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:30.681 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T04:33:30.681 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:30.732 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T04:33:30.753 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T04:33:30.753 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:30.754 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T04:33:30.754 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T04:33:30.754 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T04:33:30.754 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:31.089 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T04:33:31.112 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T04:33:31.112 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:33:31.112 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T04:33:31.112 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T04:33:31.112 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T04:33:31.112 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:35.310 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T04:33:35.352 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T04:33:35.393 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T04:33:35.424 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T04:33:35.451 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T04:33:35.646 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T04:33:35.690 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T04:33:35.719 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T04:33:35.749 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T04:33:35.795 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T04:33:36.417 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:33:36.451 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:33:36.472 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:33:37.364 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T04:33:37.456 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T04:33:37.498 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T04:33:37.581 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T04:33:37.609 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T04:33:37.634 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T04:33:37.668 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T04:33:37.669 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T04:33:37.744 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T04:33:37.744 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T04:33:37.828 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T04:33:37.853 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T04:33:37.859 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:33:37.859 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:33:38.038 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:33:38.039 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T04:33:38.122 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T04:33:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:33:44.556 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:33:44.556 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T04:33:44.556 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T04:33:44.556 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T04:33:44.557 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T04:33:44.557 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T04:33:44.557 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T04:33:44.557 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T04:33:44.557 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:33:44.557 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:33:44.557 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T04:33:44.557 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T04:33:44.557 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T04:33:44.557 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T04:33:44.557 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:33:44.557 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T04:33:44.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T04:33:44.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T04:33:44.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T04:33:44.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T04:33:44.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T04:33:44.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T04:33:44.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T04:33:44.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T04:33:44.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T04:33:44.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T04:33:44.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T04:33:44.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T04:33:44.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T04:33:44.559 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T04:33:44.559 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T04:33:44.571 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T04:33:44.571 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T04:33:44.571 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T04:33:44.571 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T04:33:44.571 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T04:33:44.571 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T04:33:44.571 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T04:33:44.571 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T04:33:44.571 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T04:33:44.571 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T04:33:44.572 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T04:33:44.572 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T04:33:44.572 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T04:33:44.572 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T04:33:44.572 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T04:33:44.572 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T04:33:44.572 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T04:33:44.572 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T04:33:44.572 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T04:33:44.572 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T04:33:44.572 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T04:33:44.572 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T04:33:44.573 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T04:33:44.573 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T04:33:44.573 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T04:33:44.573 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T04:33:44.573 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T04:33:44.573 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T04:33:44.573 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T04:33:44.573 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T04:33:44.573 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T04:33:44.573 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T04:33:44.573 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T04:33:44.573 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T04:33:44.573 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T04:33:44.574 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T04:33:44.574 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T04:33:44.574 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T04:33:44.574 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T04:33:44.574 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T04:33:44.574 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T04:33:44.574 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T04:33:44.574 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T04:33:44.574 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T04:33:44.574 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T04:33:44.574 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T04:33:44.574 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T04:33:44.574 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T04:33:44.574 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T04:33:44.575 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T04:33:44.575 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T04:33:44.575 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T04:33:44.575 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T04:33:44.575 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T04:33:44.575 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T04:33:44.575 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T04:33:44.575 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T04:33:44.575 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T04:33:44.575 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T04:33:44.575 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T04:33:44.575 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T04:33:44.576 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T04:33:44.576 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T04:33:44.576 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T04:33:44.576 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T04:33:44.576 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T04:33:44.576 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T04:33:44.576 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T04:33:44.576 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T04:33:44.576 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T04:33:44.576 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T04:33:44.576 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T04:33:44.576 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T04:33:44.576 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T04:33:44.577 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T04:33:44.577 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T04:33:44.577 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T04:33:44.577 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T04:33:44.577 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T04:33:44.577 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T04:33:44.577 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T04:33:44.577 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T04:33:44.577 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T04:33:44.577 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T04:33:44.577 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T04:33:44.577 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T04:33:44.577 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T04:33:44.578 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T04:33:44.578 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T04:33:44.578 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T04:33:44.578 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T04:33:44.580 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T04:33:44.580 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T04:33:44.580 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T04:33:44.580 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T04:33:44.580 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T04:33:44.580 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T04:33:44.580 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T04:33:44.580 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T04:33:44.581 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T04:33:44.581 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T04:33:44.581 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T04:33:44.581 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T04:33:44.581 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T04:33:44.581 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T04:33:44.581 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T04:33:44.581 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T04:33:44.581 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T04:33:44.581 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T04:33:44.581 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T04:33:44.581 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T04:33:44.581 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T04:33:44.582 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T04:33:44.582 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T04:33:44.582 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T04:33:44.582 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T04:33:44.582 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T04:33:44.582 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T04:33:44.582 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T04:33:44.582 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T04:33:44.582 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T04:33:44.582 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T04:33:44.582 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T04:33:44.582 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T04:33:44.582 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T04:33:44.582 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T04:33:44.582 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T04:33:44.583 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T04:33:44.583 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T04:33:44.583 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T04:33:44.583 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T04:33:44.583 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T04:33:44.583 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T04:33:44.583 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T04:33:47.115 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:33:47.115 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:47.115 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2024-09-17T04:33:47.115 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T04:33:47.115 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T04:33:47.115 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T04:33:47.116 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T04:33:47.116 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.116 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.116 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T04:33:47.116 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T04:33:47.116 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-09-17T04:33:47.116 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T04:33:47.116 INFO:teuthology.orchestra.run.smithi062.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T04:33:47.116 INFO:teuthology.orchestra.run.smithi062.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T04:33:47.116 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T04:33:47.116 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.116 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.117 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.117 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.117 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:47.117 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.117 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.117 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.117 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:47.117 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:47.117 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:47.117 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:47.117 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:47.117 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.118 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.118 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:47.118 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.118 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.118 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.118 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:47.118 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:47.118 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.118 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.118 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:33:47.118 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T04:33:47.119 INFO:teuthology.orchestra.run.smithi062.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T04:33:47.119 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T04:33:47.119 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T04:33:47.119 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T04:33:47.119 INFO:teuthology.orchestra.run.smithi062.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T04:33:47.119 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T04:33:47.119 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T04:33:47.119 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T04:33:47.119 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T04:33:47.119 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T04:33:47.119 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.119 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.120 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.120 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T04:33:47.120 INFO:teuthology.orchestra.run.smithi062.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T04:33:47.120 INFO:teuthology.orchestra.run.smithi062.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T04:33:47.120 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T04:33:47.120 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T04:33:47.120 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T04:33:47.120 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.120 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.120 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T04:33:47.120 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.120 INFO:teuthology.orchestra.run.smithi062.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T04:33:47.121 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T04:33:47.121 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T04:33:47.121 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T04:33:47.121 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T04:33:47.121 INFO:teuthology.orchestra.run.smithi062.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T04:33:47.121 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T04:33:47.121 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T04:33:47.121 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T04:33:47.121 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T04:33:47.121 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T04:33:47.121 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T04:33:47.121 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T04:33:47.121 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T04:33:47.122 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T04:33:47.122 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T04:33:47.122 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T04:33:47.122 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T04:33:47.122 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T04:33:47.122 INFO:teuthology.orchestra.run.smithi062.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T04:33:47.122 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T04:33:47.122 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T04:33:47.122 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T04:33:47.122 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.123 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.123 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T04:33:47.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T04:33:47.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T04:33:47.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T04:33:47.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T04:33:47.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T04:33:47.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T04:33:47.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T04:33:47.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T04:33:47.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T04:33:47.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T04:33:47.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T04:33:47.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T04:33:47.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T04:33:47.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T04:33:47.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T04:33:47.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T04:33:47.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T04:33:47.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T04:33:47.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T04:33:47.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T04:33:47.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T04:33:47.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T04:33:47.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T04:33:47.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T04:33:47.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T04:33:47.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T04:33:47.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T04:33:47.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T04:33:47.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T04:33:47.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T04:33:47.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T04:33:47.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T04:33:47.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T04:33:47.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T04:33:47.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T04:33:47.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T04:33:47.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T04:33:47.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T04:33:47.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T04:33:47.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T04:33:47.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T04:33:47.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T04:33:47.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T04:33:47.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T04:33:47.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T04:33:47.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T04:33:47.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T04:33:47.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T04:33:47.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T04:33:47.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T04:33:47.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T04:33:47.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T04:33:47.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T04:33:47.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T04:33:47.129 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T04:33:47.129 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T04:33:47.129 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T04:33:47.129 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.129 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.129 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:33:47.129 INFO:teuthology.orchestra.run.smithi062.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T04:33:47.129 INFO:teuthology.orchestra.run.smithi062.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T04:33:47.130 INFO:teuthology.orchestra.run.smithi062.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T04:33:47.130 INFO:teuthology.orchestra.run.smithi062.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T04:33:47.130 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T04:33:47.130 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T04:33:47.130 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T04:33:47.130 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:47.130 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-09-17T04:33:47.693 DEBUG:teuthology.parallel:result is None 2024-09-17T04:33:47.693 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:33:47.833 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T04:33:47.860 INFO:teuthology.orchestra.run.smithi043.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T04:33:47.861 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T04:33:47.861 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T04:33:47.864 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:33:48.006 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T04:33:48.031 INFO:teuthology.orchestra.run.smithi062.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T04:33:48.031 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T04:33:48.031 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T04:33:48.033 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T04:33:48.033 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:33:48.034 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T04:33:48.067 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:33:48.067 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T04:33:48.100 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T04:33:48.100 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:33:48.100 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T04:33:48.137 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T04:33:48.207 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:33:48.207 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T04:33:48.233 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T04:33:48.299 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T04:33:48.299 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:33:48.299 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T04:33:48.329 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T04:33:48.396 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:33:48.397 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T04:33:48.421 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T04:33:48.487 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T04:33:48.487 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:33:48.487 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T04:33:48.514 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T04:33:48.579 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:33:48.580 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T04:33:48.604 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T04:33:48.669 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T04:33:48.751 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T04:33:48.752 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /var/log/ceph 2024-09-17T04:33:48.756 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2024-09-17T04:33:48.796 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T04:33:48.797 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T04:33:48.839 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T04:33:48.864 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T04:33:48.864 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T04:33:48.906 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T04:33:48.937 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-17T04:33:48.937 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-17T04:33:48.937 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-17T04:33:48.937 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:33:48.937 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T04:33:48.986 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T04:33:49.096 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T04:33:49.122 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:33:49.122 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T04:33:49.137 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T04:33:49.248 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T04:33:49.278 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T04:33:49.278 INFO:tasks.ceph:config {'conf': {'client': {'client_shutdown_timeout': 120}, 'global': {'ms die on skipped message': False}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T04:33:49.278 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908543', 'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7908543', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240916.200549-debug'}, 'ceph': {'cephfs': {'max_mds': 3, 'session_timeout': 300}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_shutdown_timeout': 120}, 'global': {'ms die on skipped message': False}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 476, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'sleep_before_teardown': 0, 'subset': '320/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240916.200549-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi043.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGPauQUNEcuKU6bDtbD1c4ZlApBG6Rp7Cjr3yxDsf9rYZkG3qNL5rTPfDKUg93USrAzPLFHY3TRQ2oG8PbsxNgk=', 'smithi062.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEvz3g6JQjo/xiFovJV7JJvxhnmAg48WRLE+a11YoMzDLVtJbmn3uQPmcvTFcHFgan+xsSq6I/eZoXtNWEkXFsU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_shutdown_timeout': 120}, 'global': {'ms die on skipped message': False}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'cluster': 'ceph'}}, {'kclient': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['fs/misc/trivial_sync.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_02:09:51', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T04:33:49.279 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T04:33:49.281 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T04:33:49.328 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T04:33:49.336 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T04:33:49.393 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:33:49.393 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T04:33:49.415 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T04:33:49.416 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_1 2024-09-17T04:33:49.471 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T04:33:49.471 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:33:49.471 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-17T04:33:49.472 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:33:49.472 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:33:49.472 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-17 04:33:21.711845513 +0000 2024-09-17T04:33:49.472 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-17 04:30:58.807478830 +0000 2024-09-17T04:33:49.472 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-17 04:30:58.807478830 +0000 2024-09-17T04:33:49.472 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-09-17 04:30:58.807478830 +0000 2024-09-17T04:33:49.472 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T04:33:49.536 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-17T04:33:49.536 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-17T04:33:49.536 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000101199 s, 5.1 MB/s 2024-09-17T04:33:49.537 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T04:33:49.595 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_2 2024-09-17T04:33:49.650 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T04:33:49.651 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:33:49.651 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-17T04:33:49.651 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:33:49.651 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:33:49.651 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-17 04:33:21.712845501 +0000 2024-09-17T04:33:49.651 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-17 04:30:59.143474737 +0000 2024-09-17T04:33:49.651 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-17 04:30:59.143474737 +0000 2024-09-17T04:33:49.651 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-09-17 04:30:59.143474737 +0000 2024-09-17T04:33:49.651 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T04:33:49.715 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-17T04:33:49.715 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-17T04:33:49.715 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000100669 s, 5.1 MB/s 2024-09-17T04:33:49.716 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T04:33:49.773 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_3 2024-09-17T04:33:49.829 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T04:33:49.830 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:33:49.830 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-17T04:33:49.830 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:33:49.830 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:33:49.830 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-17 04:33:21.712845501 +0000 2024-09-17T04:33:49.830 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-17 04:30:59.483470594 +0000 2024-09-17T04:33:49.830 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-17 04:30:59.483470594 +0000 2024-09-17T04:33:49.830 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-09-17 04:30:59.483470594 +0000 2024-09-17T04:33:49.830 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T04:33:49.893 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-17T04:33:49.894 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-17T04:33:49.894 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 9.6167e-05 s, 5.3 MB/s 2024-09-17T04:33:49.896 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T04:33:49.952 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_4 2024-09-17T04:33:50.008 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T04:33:50.009 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:33:50.009 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-17T04:33:50.009 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:33:50.009 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:33:50.009 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-17 04:33:21.712845501 +0000 2024-09-17T04:33:50.009 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-17 04:30:59.815466549 +0000 2024-09-17T04:33:50.009 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-17 04:30:59.815466549 +0000 2024-09-17T04:33:50.009 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-09-17 04:30:59.815466549 +0000 2024-09-17T04:33:50.009 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T04:33:50.072 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-17T04:33:50.072 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-17T04:33:50.072 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 9.8796e-05 s, 5.2 MB/s 2024-09-17T04:33:50.073 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T04:33:50.130 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T04:33:50.130 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:33:50.130 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T04:33:50.149 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T04:33:50.149 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-09-17T04:33:50.208 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T04:33:50.208 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:33:50.208 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-17T04:33:50.208 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:33:50.208 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:33:50.208 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-17 04:33:38.559104195 +0000 2024-09-17T04:33:50.208 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-17 04:31:20.563598556 +0000 2024-09-17T04:33:50.208 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-17 04:31:20.563598556 +0000 2024-09-17T04:33:50.209 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-09-17 04:31:20.563598556 +0000 2024-09-17T04:33:50.209 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T04:33:50.276 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-17T04:33:50.276 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-17T04:33:50.276 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000272052 s, 1.9 MB/s 2024-09-17T04:33:50.278 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T04:33:50.337 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-09-17T04:33:50.396 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T04:33:50.397 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:33:50.397 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-17T04:33:50.397 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:33:50.397 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:33:50.397 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-17 04:33:38.559104195 +0000 2024-09-17T04:33:50.397 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-17 04:31:20.901593366 +0000 2024-09-17T04:33:50.397 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-17 04:31:20.901593366 +0000 2024-09-17T04:33:50.397 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-09-17 04:31:20.901593366 +0000 2024-09-17T04:33:50.397 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T04:33:50.463 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-17T04:33:50.464 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-17T04:33:50.464 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000216036 s, 2.4 MB/s 2024-09-17T04:33:50.465 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T04:33:50.523 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-09-17T04:33:50.579 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T04:33:50.580 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:33:50.580 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-09-17T04:33:50.580 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:33:50.580 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:33:50.580 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-17 04:33:38.560104180 +0000 2024-09-17T04:33:50.580 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-17 04:31:21.240588160 +0000 2024-09-17T04:33:50.580 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-17 04:31:21.240588160 +0000 2024-09-17T04:33:50.580 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-09-17 04:31:21.240588160 +0000 2024-09-17T04:33:50.580 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T04:33:50.645 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-17T04:33:50.645 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-17T04:33:50.645 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000197711 s, 2.6 MB/s 2024-09-17T04:33:50.646 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T04:33:50.703 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-09-17T04:33:50.759 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T04:33:50.759 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:33:50.759 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-09-17T04:33:50.759 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:33:50.760 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:33:50.760 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-17 04:33:38.560104180 +0000 2024-09-17T04:33:50.760 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-17 04:31:21.570583092 +0000 2024-09-17T04:33:50.760 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-17 04:31:21.570583092 +0000 2024-09-17T04:33:50.760 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-09-17 04:31:21.570583092 +0000 2024-09-17T04:33:50.760 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T04:33:50.824 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-17T04:33:50.824 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-17T04:33:50.824 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000208528 s, 2.5 MB/s 2024-09-17T04:33:50.825 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T04:33:50.882 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T04:33:50.882 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T04:33:50.882 INFO:tasks.ceph:Generating config... 2024-09-17T04:33:50.884 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-09-17T04:33:50.884 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-17T04:33:50.884 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-09-17T04:33:50.884 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-09-17T04:33:50.884 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-09-17T04:33:50.884 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-09-17T04:33:50.884 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-09-17T04:33:50.884 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-09-17T04:33:50.884 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-09-17T04:33:50.884 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T04:33:50.884 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T04:33:50.885 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T04:33:50.885 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T04:33:50.885 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T04:33:50.885 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-17T04:33:50.885 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-17T04:33:50.885 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-17T04:33:50.885 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-17T04:33:50.885 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T04:33:50.885 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T04:33:50.885 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-17T04:33:50.885 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-17T04:33:50.885 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T04:33:50.885 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T04:33:50.885 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-17T04:33:50.886 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-09-17T04:33:50.886 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T04:33:50.886 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T04:33:50.886 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T04:33:50.886 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-09-17T04:33:50.886 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-09-17T04:33:50.886 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-09-17T04:33:50.886 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-09-17T04:33:50.886 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-17T04:33:50.886 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T04:33:50.886 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-17T04:33:50.886 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T04:33:50.886 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T04:33:50.887 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T04:33:50.956 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T04:33:50.960 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T04:33:51.017 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T04:33:51.043 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.43'), ('mon.b', '172.21.15.62'), ('mon.c', '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]')] 2024-09-17T04:33:51.044 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.43,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client_shutdown_timeout': 120}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}} 2024-09-17T04:33:51.045 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:33:51.045 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T04:33:51.099 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.43 --add b 172.21.15.62 --addv c '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:33:51.198 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:33:51.198 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: generated fsid cdef1e3e-07e6-43e6-b635-3ed1bc15d64a 2024-09-17T04:33:51.198 INFO:teuthology.orchestra.run.smithi043.stdout:setting min_mon_release = quincy 2024-09-17T04:33:51.198 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 0 2024-09-17T04:33:51.198 INFO:teuthology.orchestra.run.smithi043.stdout:fsid cdef1e3e-07e6-43e6-b635-3ed1bc15d64a 2024-09-17T04:33:51.198 INFO:teuthology.orchestra.run.smithi043.stdout:last_changed 2024-09-17T04:33:51.199044+0000 2024-09-17T04:33:51.198 INFO:teuthology.orchestra.run.smithi043.stdout:created 2024-09-17T04:33:51.199044+0000 2024-09-17T04:33:51.198 INFO:teuthology.orchestra.run.smithi043.stdout:min_mon_release 17 (quincy) 2024-09-17T04:33:51.198 INFO:teuthology.orchestra.run.smithi043.stdout:election_strategy: 1 2024-09-17T04:33:51.198 INFO:teuthology.orchestra.run.smithi043.stdout:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-17T04:33:51.198 INFO:teuthology.orchestra.run.smithi043.stdout:1: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2024-09-17T04:33:51.199 INFO:teuthology.orchestra.run.smithi043.stdout:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-17T04:33:51.199 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T04:33:51.200 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T04:33:51.216 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cdef1e3e-07e6-43e6-b635-3ed1bc15d64a... 2024-09-17T04:33:51.217 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T04:33:51.258 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T04:33:51.300 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2024-09-17T04:33:51.300 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2024-09-17T04:33:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T04:33:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2024-09-17T04:33:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2024-09-17T04:33:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2024-09-17T04:33:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2024-09-17T04:33:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2024-09-17T04:33:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2024-09-17T04:33:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2024-09-17T04:33:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T04:33:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2024-09-17T04:33:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T04:33:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T04:33:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2024-09-17T04:33:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2024-09-17T04:33:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2024-09-17T04:33:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2024-09-17T04:33:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2024-09-17T04:33:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2024-09-17T04:33:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2024-09-17T04:33:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2024-09-17T04:33:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T04:33:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T04:33:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2024-09-17T04:33:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T04:33:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2024-09-17T04:33:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2024-09-17T04:33:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2024-09-17T04:33:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2024-09-17T04:33:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2024-09-17T04:33:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = "172.21.15.43,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2024-09-17T04:33:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on skipped message = False 2024-09-17T04:33:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = cdef1e3e-07e6-43e6-b635-3ed1bc15d64a 2024-09-17T04:33:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.304 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2024-09-17T04:33:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2024-09-17T04:33:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2024-09-17T04:33:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2024-09-17T04:33:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: osd mclock profile = high_recovery_ops 2024-09-17T04:33:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2024-09-17T04:33:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2024-09-17T04:33:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2024-09-17T04:33:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2024-09-17T04:33:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2024-09-17T04:33:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug trim objects = true 2024-09-17T04:33:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2024-09-17T04:33:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2024-09-17T04:33:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2024-09-17T04:33:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2024-09-17T04:33:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2024-09-17T04:33:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2024-09-17T04:33:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2024-09-17T04:33:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2024-09-17T04:33:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2024-09-17T04:33:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: bdev async discard = True 2024-09-17T04:33:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: bdev enable discard = True 2024-09-17T04:33:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore allocator = bitmap 2024-09-17T04:33:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore block size = 96636764160 2024-09-17T04:33:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore fsck on mount = True 2024-09-17T04:33:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluefs = 1/20 2024-09-17T04:33:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluestore = 1/20 2024-09-17T04:33:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T04:33:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2024-09-17T04:33:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: debug rocksdb = 4/10 2024-09-17T04:33:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: mon client directed command retry = 5 2024-09-17T04:33:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T04:33:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd full ratio = 0.9 2024-09-17T04:33:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd nearfull ratio = 0.8 2024-09-17T04:33:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: ms inject delay max = 1 2024-09-17T04:33:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: ms inject delay probability = 0.005 2024-09-17T04:33:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: ms inject delay type = client mds 2024-09-17T04:33:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: ms inject socket failures = 2500 2024-09-17T04:33:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: osd blocked scrub grace period = 3600 2024-09-17T04:33:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: osd failsafe full ratio = 0.95 2024-09-17T04:33:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: osd max markdown count = 1000 2024-09-17T04:33:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: osd objectstore = bluestore 2024-09-17T04:33:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.308 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2024-09-17T04:33:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T04:33:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2024-09-17T04:33:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-17T04:33:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-17T04:33:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-17T04:33:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-17T04:33:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2024-09-17T04:33:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.308 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2024-09-17T04:33:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T04:33:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-17T04:33:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2024-09-17T04:33:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-17T04:33:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2024-09-17T04:33:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2024-09-17T04:33:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-17T04:33:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2024-09-17T04:33:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2024-09-17T04:33:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-17T04:33:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T04:33:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T04:33:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T04:33:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T04:33:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T04:33:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T04:33:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: # 1m isn't quite enough 2024-09-17T04:33:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: mon_down_mkfs_grace = 2m 2024-09-17T04:33:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_filestore_osds = false 2024-09-17T04:33:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: mon down mkfs grace = 300 2024-09-17T04:33:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:33:51.310 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2024-09-17T04:33:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2024-09-17T04:33:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2024-09-17T04:33:51.311 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2024-09-17T04:33:51.311 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T04:33:51.311 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T04:33:51.311 INFO:teuthology.orchestra.run.smithi043.stdout: client_shutdown_timeout = 120 2024-09-17T04:33:51.311 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2024-09-17T04:33:51.311 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.b] 2024-09-17T04:33:51.311 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.c] 2024-09-17T04:33:51.311 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-09-17T04:33:51.311 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c] 2024-09-17T04:33:51.312 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.e] 2024-09-17T04:33:51.312 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2024-09-17T04:33:51.312 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d] 2024-09-17T04:33:51.312 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.f] 2024-09-17T04:33:51.312 INFO:teuthology.orchestra.run.smithi043.stdout:[mds] 2024-09-17T04:33:51.312 INFO:teuthology.orchestra.run.smithi043.stdout: mds oft prefetch dirfrags = True 2024-09-17T04:33:51.312 INFO:teuthology.orchestra.run.smithi043.stdout: mds_sleep_rank_change = 5000000.0 2024-09-17T04:33:51.312 INFO:teuthology.orchestra.run.smithi043.stdout: mon client directed command retry = 5 2024-09-17T04:33:51.312 INFO:teuthology.orchestra.run.smithi043.stdout: ms inject delay max = 1 2024-09-17T04:33:51.312 INFO:teuthology.orchestra.run.smithi043.stdout: ms inject delay probability = 0.005 2024-09-17T04:33:51.312 INFO:teuthology.orchestra.run.smithi043.stdout: ms inject delay type = client mds osd 2024-09-17T04:33:51.312 INFO:teuthology.orchestra.run.smithi043.stdout: ms inject socket failures = 2500 2024-09-17T04:33:51.313 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2024-09-17T04:33:51.313 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2024-09-17T04:33:51.313 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T04:33:51.313 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2024-09-17T04:33:51.313 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.313 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2024-09-17T04:33:51.314 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.314 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2024-09-17T04:33:51.314 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.314 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2024-09-17T04:33:51.314 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2024-09-17T04:33:51.314 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.314 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2024-09-17T04:33:51.314 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2024-09-17T04:33:51.314 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.314 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T04:33:51.314 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2024-09-17T04:33:51.314 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.314 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T04:33:51.315 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T04:33:51.315 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.315 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2024-09-17T04:33:51.315 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.315 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2024-09-17T04:33:51.315 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2024-09-17T04:33:51.315 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2024-09-17T04:33:51.315 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2024-09-17T04:33:51.315 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2024-09-17T04:33:51.315 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2024-09-17T04:33:51.315 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2024-09-17T04:33:51.315 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T04:33:51.315 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T04:33:51.316 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2024-09-17T04:33:51.316 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.316 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T04:33:51.316 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.316 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2024-09-17T04:33:51.316 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.316 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2024-09-17T04:33:51.316 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.316 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2024-09-17T04:33:51.316 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2024-09-17T04:33:51.316 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2024-09-17T04:33:51.316 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.43,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2024-09-17T04:33:51.317 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on skipped message = False 2024-09-17T04:33:51.317 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = cdef1e3e-07e6-43e6-b635-3ed1bc15d64a 2024-09-17T04:33:51.317 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.317 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2024-09-17T04:33:51.317 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2024-09-17T04:33:51.317 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.317 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2024-09-17T04:33:51.317 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2024-09-17T04:33:51.317 INFO:teuthology.orchestra.run.smithi062.stdout: osd mclock profile = high_recovery_ops 2024-09-17T04:33:51.317 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.317 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2024-09-17T04:33:51.317 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2024-09-17T04:33:51.317 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.317 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2024-09-17T04:33:51.318 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2024-09-17T04:33:51.318 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2024-09-17T04:33:51.318 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug trim objects = true 2024-09-17T04:33:51.318 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.318 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2024-09-17T04:33:51.318 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2024-09-17T04:33:51.318 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.318 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2024-09-17T04:33:51.318 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.318 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2024-09-17T04:33:51.318 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.318 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2024-09-17T04:33:51.318 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.319 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2024-09-17T04:33:51.319 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2024-09-17T04:33:51.319 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.319 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2024-09-17T04:33:51.319 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2024-09-17T04:33:51.319 INFO:teuthology.orchestra.run.smithi062.stdout: bdev async discard = True 2024-09-17T04:33:51.319 INFO:teuthology.orchestra.run.smithi062.stdout: bdev enable discard = True 2024-09-17T04:33:51.319 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore allocator = bitmap 2024-09-17T04:33:51.319 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2024-09-17T04:33:51.319 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2024-09-17T04:33:51.319 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 1/20 2024-09-17T04:33:51.319 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 1/20 2024-09-17T04:33:51.319 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-09-17T04:33:51.320 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2024-09-17T04:33:51.320 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 4/10 2024-09-17T04:33:51.320 INFO:teuthology.orchestra.run.smithi062.stdout: mon client directed command retry = 5 2024-09-17T04:33:51.320 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T04:33:51.320 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2024-09-17T04:33:51.320 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2024-09-17T04:33:51.320 INFO:teuthology.orchestra.run.smithi062.stdout: ms inject delay max = 1 2024-09-17T04:33:51.320 INFO:teuthology.orchestra.run.smithi062.stdout: ms inject delay probability = 0.005 2024-09-17T04:33:51.320 INFO:teuthology.orchestra.run.smithi062.stdout: ms inject delay type = client mds 2024-09-17T04:33:51.320 INFO:teuthology.orchestra.run.smithi062.stdout: ms inject socket failures = 2500 2024-09-17T04:33:51.320 INFO:teuthology.orchestra.run.smithi062.stdout: osd blocked scrub grace period = 3600 2024-09-17T04:33:51.320 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2024-09-17T04:33:51.320 INFO:teuthology.orchestra.run.smithi062.stdout: osd max markdown count = 1000 2024-09-17T04:33:51.321 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2024-09-17T04:33:51.321 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.321 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2024-09-17T04:33:51.321 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-09-17T04:33:51.321 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2024-09-17T04:33:51.321 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-09-17T04:33:51.321 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-09-17T04:33:51.321 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-09-17T04:33:51.321 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-09-17T04:33:51.321 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2024-09-17T04:33:51.321 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.321 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2024-09-17T04:33:51.321 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-09-17T04:33:51.322 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-09-17T04:33:51.322 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2024-09-17T04:33:51.322 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-09-17T04:33:51.322 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2024-09-17T04:33:51.322 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2024-09-17T04:33:51.322 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-09-17T04:33:51.322 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2024-09-17T04:33:51.322 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2024-09-17T04:33:51.322 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-09-17T04:33:51.322 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.322 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T04:33:51.322 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T04:33:51.322 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T04:33:51.322 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.322 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T04:33:51.323 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T04:33:51.323 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T04:33:51.323 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.323 INFO:teuthology.orchestra.run.smithi062.stdout: # 1m isn't quite enough 2024-09-17T04:33:51.323 INFO:teuthology.orchestra.run.smithi062.stdout: mon_down_mkfs_grace = 2m 2024-09-17T04:33:51.323 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.323 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_filestore_osds = false 2024-09-17T04:33:51.323 INFO:teuthology.orchestra.run.smithi062.stdout: mon down mkfs grace = 300 2024-09-17T04:33:51.323 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-17T04:33:51.323 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2024-09-17T04:33:51.323 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2024-09-17T04:33:51.323 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2024-09-17T04:33:51.323 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2024-09-17T04:33:51.323 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T04:33:51.324 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T04:33:51.324 INFO:teuthology.orchestra.run.smithi062.stdout: client_shutdown_timeout = 120 2024-09-17T04:33:51.324 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2024-09-17T04:33:51.324 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2024-09-17T04:33:51.324 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2024-09-17T04:33:51.324 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2024-09-17T04:33:51.324 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2024-09-17T04:33:51.324 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.e] 2024-09-17T04:33:51.324 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2024-09-17T04:33:51.324 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.d] 2024-09-17T04:33:51.324 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.f] 2024-09-17T04:33:51.324 INFO:teuthology.orchestra.run.smithi062.stdout:[mds] 2024-09-17T04:33:51.324 INFO:teuthology.orchestra.run.smithi062.stdout: mds oft prefetch dirfrags = True 2024-09-17T04:33:51.325 INFO:teuthology.orchestra.run.smithi062.stdout: mds_sleep_rank_change = 5000000.0 2024-09-17T04:33:51.325 INFO:teuthology.orchestra.run.smithi062.stdout: mon client directed command retry = 5 2024-09-17T04:33:51.325 INFO:teuthology.orchestra.run.smithi062.stdout: ms inject delay max = 1 2024-09-17T04:33:51.325 INFO:teuthology.orchestra.run.smithi062.stdout: ms inject delay probability = 0.005 2024-09-17T04:33:51.325 INFO:teuthology.orchestra.run.smithi062.stdout: ms inject delay type = client mds osd 2024-09-17T04:33:51.325 INFO:teuthology.orchestra.run.smithi062.stdout: ms inject socket failures = 2500 2024-09-17T04:33:51.326 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T04:33:51.327 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T04:33:51.434 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T04:33:51.434 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:33:51.435 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T04:33:51.450 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:33:51.451 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T04:33:51.506 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T04:33:51.506 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:33:51.506 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T04:33:51.506 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T04:33:51.581 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:33:51.581 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:33:51.637 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2024-09-17T04:33:51.638 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:33:51.638 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T04:33:51.638 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T04:33:51.675 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:33:51.676 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:33:51.732 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T04:33:51.732 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T04:33:51.732 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T04:33:51.795 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T04:33:51.797 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T04:33:51.873 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T04:33:51.876 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T04:33:51.876 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T04:33:51.939 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T04:33:51.942 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-17T04:33:51.967 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T04:33:52.068 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T04:33:52.071 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-17T04:33:52.097 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-09-17T04:33:52.200 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-09-17T04:33:52.203 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-09-17T04:33:52.228 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T04:33:52.291 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T04:33:52.294 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-17T04:33:52.318 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T04:33:52.418 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T04:33:52.421 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-17T04:33:52.445 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-09-17T04:33:52.545 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-09-17T04:33:52.548 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-09-17T04:33:52.571 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T04:33:52.572 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T04:33:52.624 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T04:33:52.641 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T04:33:52.641 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T04:33:52.642 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T04:33:52.667 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T04:33:52.667 INFO:tasks.ceph:role: osd.0 2024-09-17T04:33:52.667 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T04:33:52.667 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T04:33:52.733 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:33:52.733 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:33:52.733 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:33:52.733 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:33:52.733 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:33:52.734 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:33:52.734 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:33:52.734 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:33:52.734 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:33:52.734 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:33:52.765 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-09-17T04:33:52.767 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-09-17T04:33:52.768 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T04:33:52.838 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T04:33:52.906 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T04:33:52.972 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T04:33:52.973 INFO:tasks.ceph:role: osd.1 2024-09-17T04:33:52.973 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T04:33:52.973 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T04:33:53.038 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:33:53.038 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:33:53.038 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:33:53.038 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:33:53.038 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:33:53.038 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:33:53.038 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:33:53.038 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:33:53.038 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:33:53.038 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:33:53.070 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-09-17T04:33:53.073 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-09-17T04:33:53.073 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T04:33:53.141 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T04:33:53.211 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T04:33:53.278 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T04:33:53.278 INFO:tasks.ceph:role: osd.2 2024-09-17T04:33:53.278 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T04:33:53.279 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T04:33:53.344 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:33:53.344 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:33:53.344 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:33:53.344 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:33:53.344 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:33:53.344 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:33:53.344 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:33:53.345 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:33:53.345 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:33:53.345 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:33:53.377 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-09-17T04:33:53.379 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-09-17T04:33:53.379 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T04:33:53.448 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T04:33:53.518 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T04:33:53.584 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T04:33:53.584 INFO:tasks.ceph:role: osd.3 2024-09-17T04:33:53.584 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T04:33:53.584 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T04:33:53.648 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:33:53.649 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:33:53.649 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:33:53.649 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:33:53.649 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:33:53.649 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:33:53.649 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:33:53.649 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:33:53.649 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:33:53.649 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:33:53.681 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-09-17T04:33:53.683 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-09-17T04:33:53.683 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-17T04:33:53.752 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T04:33:53.823 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:33:53.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:33:53.931+0000 7f6ae980f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T04:33:53.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:33:53.931+0000 7f6ae980f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T04:33:53.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:33:53.931+0000 7f6ae980f640 -1 bdev(0x55e55dd8f900 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T04:33:53.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:33:53.931+0000 7f6ae980f640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T04:33:57.343 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T04:33:57.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:33:57.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:33:57.479+0000 7f54d621f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T04:33:57.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:33:57.479+0000 7f54d621f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T04:33:57.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:33:57.480+0000 7f54d621f640 -1 bdev(0x555772a25900 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T04:33:57.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:33:57.480+0000 7f54d621f640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T04:34:00.386 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T04:34:00.417 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:34:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:00.522+0000 7f6d072d6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T04:34:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:00.522+0000 7f6d072d6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T04:34:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:00.522+0000 7f6d072d6640 -1 bdev(0x561feaa33900 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T04:34:00.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:00.523+0000 7f6d072d6640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T04:34:03.692 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T04:34:03.723 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:34:03.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:03.828+0000 7f17d35b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T04:34:03.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:03.828+0000 7f17d35b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T04:34:03.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:03.828+0000 7f17d35b2640 -1 bdev(0x55b6134e1900 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T04:34:03.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:03.829+0000 7f17d35b2640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T04:34:06.992 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T04:34:07.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T04:34:07.054 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T04:34:07.054 INFO:tasks.ceph:role: osd.4 2024-09-17T04:34:07.054 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-17T04:34:07.054 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T04:34:07.130 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:34:07.130 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:34:07.130 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:34:07.130 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:34:07.130 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:34:07.130 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:34:07.130 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:34:07.130 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:34:07.130 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:34:07.131 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:34:07.625 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-09-17T04:34:07.627 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-09-17T04:34:07.627 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-17T04:34:07.761 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T04:34:07.796 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T04:34:07.865 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T04:34:07.865 INFO:tasks.ceph:role: osd.5 2024-09-17T04:34:07.865 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-17T04:34:07.865 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T04:34:07.940 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:34:07.940 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:34:07.940 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:34:07.940 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:34:07.940 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:34:07.940 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:34:07.941 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:34:07.941 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:34:07.941 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:34:07.941 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:34:08.397 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-09-17T04:34:08.398 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-09-17T04:34:08.399 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T04:34:08.487 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T04:34:08.516 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T04:34:08.582 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T04:34:08.582 INFO:tasks.ceph:role: osd.6 2024-09-17T04:34:08.582 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-17T04:34:08.582 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T04:34:08.657 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:34:08.657 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:34:08.658 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:34:08.658 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:34:08.658 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:34:08.658 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:34:08.658 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:34:08.658 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:34:08.659 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:34:08.659 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:34:09.138 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-09-17T04:34:09.140 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-09-17T04:34:09.140 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-17T04:34:09.287 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T04:34:09.316 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T04:34:09.381 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T04:34:09.381 INFO:tasks.ceph:role: osd.7 2024-09-17T04:34:09.381 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-17T04:34:09.381 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T04:34:09.453 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:34:09.453 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:34:09.453 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:34:09.453 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:34:09.453 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:34:09.453 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:34:09.453 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:34:09.453 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:34:09.453 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:34:09.454 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:34:09.963 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-09-17T04:34:09.965 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-09-17T04:34:09.966 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-17T04:34:10.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T04:34:10.135 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:34:10.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:10.246+0000 7f1054411640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T04:34:10.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:10.246+0000 7f1054411640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T04:34:10.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:10.246+0000 7f1054411640 -1 bdev(0x5647dcb0d900 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T04:34:10.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:10.246+0000 7f1054411640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T04:34:13.172 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T04:34:13.202 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:34:13.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:13.309+0000 7f77e13fd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T04:34:13.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:13.310+0000 7f77e13fd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T04:34:13.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:13.310+0000 7f77e13fd640 -1 bdev(0x557e83ecf900 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T04:34:13.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:13.310+0000 7f77e13fd640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T04:34:16.223 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T04:34:16.252 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:34:16.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:16.354+0000 7f1bfca39640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T04:34:16.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:16.354+0000 7f1bfca39640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T04:34:16.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:16.354+0000 7f1bfca39640 -1 bdev(0x55b295813900 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-17T04:34:16.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:16.354+0000 7f1bfca39640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-17T04:34:19.280 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:34:19.285 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:34:19.772 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T04:34:19.799 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:34:19.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:19.898+0000 7fe083818640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T04:34:19.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:19.898+0000 7fe083818640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T04:34:19.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:19.898+0000 7fe083818640 -1 bdev(0x55f397cc3900 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-17T04:34:19.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:19.898+0000 7fe083818640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-17T04:34:23.317 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T04:34:23.346 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T04:34:23.347 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:34:23.347 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T04:34:23.379 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:34:23.379 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-17T04:34:23.449 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:34:23.450 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-17T04:34:23.518 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:34:23.518 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-09-17T04:34:23.587 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:34:23.587 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T04:34:23.654 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:34:23.654 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T04:34:23.722 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:34:23.722 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T04:34:23.788 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:34:23.789 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T04:34:23.855 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:34:23.855 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T04:34:23.885 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:34:23.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-17T04:34:23.954 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:34:23.954 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-17T04:34:24.023 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:34:24.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-09-17T04:34:24.090 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:34:24.090 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T04:34:24.157 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:34:24.157 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T04:34:24.223 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:34:24.223 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T04:34:24.289 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:34:24.289 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T04:34:24.354 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:34:24.354 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T04:34:24.373 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T04:34:24.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T04:34:24.416 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T04:34:24.440 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2024-09-17T04:34:24.441 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCvBulmxqduLxAAIVZymyseHGoIxqu/m+XL+w== 2024-09-17T04:34:24.441 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2024-09-17T04:34:24.441 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCvBulmujwQOBAA80bVMcGozP4aZD60W31qmQ== 2024-09-17T04:34:24.441 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2024-09-17T04:34:24.441 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCwBulmTectBBAApKmvrtyK/XbYEncWVKMi4g== 2024-09-17T04:34:24.441 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.e] 2024-09-17T04:34:24.441 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCwBulmKFz/CxAAPDSqF6eg3ammMORGHmkWbQ== 2024-09-17T04:34:24.441 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2024-09-17T04:34:24.441 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCxBulmPk2PNxAAhJTLoo0vxud4W4wnolz1Lg== 2024-09-17T04:34:24.441 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2024-09-17T04:34:24.441 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQC1Bulmw52lHBAApF7EKsefF4+usp/KDAFUZA== 2024-09-17T04:34:24.441 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2024-09-17T04:34:24.442 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQC4BulmQD80HxAAtVHxyu0zgd/hKz9HnwLAew== 2024-09-17T04:34:24.442 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2024-09-17T04:34:24.442 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQC7BulmWNZwMRAAqM64rPqw+cxXtIXi5repWA== 2024-09-17T04:34:24.442 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2024-09-17T04:34:24.442 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCvBulmh0siNBAAEex6cCfoJowxPSQrWXJH8w== 2024-09-17T04:34:24.442 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2024-09-17T04:34:24.442 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCwBulmEAppERAAgX7Ye8UjE31qPrxrYzBQDg== 2024-09-17T04:34:24.442 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.d] 2024-09-17T04:34:24.442 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCwBulmDM38GBAAf9GhREqw4tEz4X+cLkLUoQ== 2024-09-17T04:34:24.442 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.f] 2024-09-17T04:34:24.442 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCwBulmgR2OIBAAHW4BFdlokCEZ5G3JKb4IMA== 2024-09-17T04:34:24.442 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.4] 2024-09-17T04:34:24.442 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDCBulmlNXCDhAA6YlM+ZquZzNhKJWSgGSXnA== 2024-09-17T04:34:24.443 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.5] 2024-09-17T04:34:24.443 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDFBulmUdmNEhAAxRSSQmaaSVM69Z/PvYS9GQ== 2024-09-17T04:34:24.443 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.6] 2024-09-17T04:34:24.443 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDIBulm96wvFRAAjqyZCsJ7P2CIWCzn0Z1VkA== 2024-09-17T04:34:24.443 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.7] 2024-09-17T04:34:24.443 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDLBulmkEucNRAAApj/uZqXOA+OMH1pwtWKGg== 2024-09-17T04:34:24.443 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2024-09-17T04:34:24.443 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCwBulm73FSJRAA/1FlD/BSTVbEMz99wmG+Eg== 2024-09-17T04:34:24.444 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.y] 2024-09-17T04:34:24.444 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCvBulmxqduLxAAIVZymyseHGoIxqu/m+XL+w== 2024-09-17T04:34:24.445 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-09-17T04:34:24.445 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCvBulmujwQOBAA80bVMcGozP4aZD60W31qmQ== 2024-09-17T04:34:24.445 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c] 2024-09-17T04:34:24.445 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCwBulmTectBBAApKmvrtyK/XbYEncWVKMi4g== 2024-09-17T04:34:24.445 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.e] 2024-09-17T04:34:24.445 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCwBulmKFz/CxAAPDSqF6eg3ammMORGHmkWbQ== 2024-09-17T04:34:24.445 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.0] 2024-09-17T04:34:24.445 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCxBulmPk2PNxAAhJTLoo0vxud4W4wnolz1Lg== 2024-09-17T04:34:24.445 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.1] 2024-09-17T04:34:24.445 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQC1Bulmw52lHBAApF7EKsefF4+usp/KDAFUZA== 2024-09-17T04:34:24.445 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.2] 2024-09-17T04:34:24.445 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQC4BulmQD80HxAAtVHxyu0zgd/hKz9HnwLAew== 2024-09-17T04:34:24.446 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.3] 2024-09-17T04:34:24.446 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQC7BulmWNZwMRAAqM64rPqw+cxXtIXi5repWA== 2024-09-17T04:34:24.446 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.x] 2024-09-17T04:34:24.446 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCvBulmh0siNBAAEex6cCfoJowxPSQrWXJH8w== 2024-09-17T04:34:24.446 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2024-09-17T04:34:24.446 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCwBulmEAppERAAgX7Ye8UjE31qPrxrYzBQDg== 2024-09-17T04:34:24.446 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d] 2024-09-17T04:34:24.446 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCwBulmDM38GBAAf9GhREqw4tEz4X+cLkLUoQ== 2024-09-17T04:34:24.446 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.f] 2024-09-17T04:34:24.446 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCwBulmgR2OIBAAHW4BFdlokCEZ5G3JKb4IMA== 2024-09-17T04:34:24.446 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.4] 2024-09-17T04:34:24.446 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDCBulmlNXCDhAA6YlM+ZquZzNhKJWSgGSXnA== 2024-09-17T04:34:24.446 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.5] 2024-09-17T04:34:24.446 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDFBulmUdmNEhAAxRSSQmaaSVM69Z/PvYS9GQ== 2024-09-17T04:34:24.446 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.6] 2024-09-17T04:34:24.447 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDIBulm96wvFRAAjqyZCsJ7P2CIWCzn0Z1VkA== 2024-09-17T04:34:24.447 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.7] 2024-09-17T04:34:24.447 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDLBulmkEucNRAAApj/uZqXOA+OMH1pwtWKGg== 2024-09-17T04:34:24.447 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2024-09-17T04:34:24.447 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCwBulm73FSJRAA/1FlD/BSTVbEMz99wmG+Eg== 2024-09-17T04:34:24.447 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T04:34:24.487 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T04:34:24.555 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:34:24.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:34:24.624 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:34:24.626 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:34:24.691 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:34:24.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:34:24.757 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:34:24.759 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:34:24.820 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:34:24.823 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:34:24.884 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:34:24.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:34:24.947 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:34:24.949 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:34:25.010 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T04:34:25.013 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T04:34:25.074 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:34:25.076 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:34:25.140 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:34:25.142 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:34:25.206 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:34:25.209 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:34:25.272 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:34:25.275 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:34:25.336 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:34:25.339 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:34:25.400 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:34:25.402 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:34:25.463 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:34:25.465 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:34:25.527 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:34:25.529 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:34:25.593 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T04:34:25.594 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T04:34:25.620 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T04:34:25.729 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T04:34:25.754 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T04:34:25.780 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T04:34:25.887 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T04:34:25.911 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T04:34:25.975 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T04:34:26.083 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T04:34:26.107 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:34:26.109 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:34:26.162 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T04:34:26.163 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T04:34:26.163 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T04:34:26.166 INFO:tasks.ceph.mon.a:Started 2024-09-17T04:34:26.166 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T04:34:26.166 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T04:34:26.204 INFO:tasks.ceph.mon.b:Started 2024-09-17T04:34:26.205 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T04:34:26.205 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T04:34:26.207 INFO:tasks.ceph.mon.c:Started 2024-09-17T04:34:26.207 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T04:34:26.207 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T04:34:26.207 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T04:34:26.210 INFO:tasks.ceph.mgr.y:Started 2024-09-17T04:34:26.210 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T04:34:26.210 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T04:34:26.212 INFO:tasks.ceph.mgr.x:Started 2024-09-17T04:34:26.212 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-17T04:34:26.212 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-17T04:34:26.214 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-17T04:34:26.214 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-17T04:34:26.257 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-17T04:34:26.258 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-17T04:34:26.301 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-17T04:34:26.301 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-17T04:34:26.343 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-17T04:34:26.344 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-17T04:34:26.386 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-17T04:34:26.387 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-17T04:34:26.430 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-17T04:34:26.430 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-17T04:34:26.472 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-17T04:34:26.473 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-17T04:34:26.517 INFO:tasks.ceph:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-17T04:34:26.517 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mds mds_bal_fragment_size_max 10000 2024-09-17T04:34:26.564 INFO:tasks.ceph:setting config [mds] mds_bal_merge_size = 5 2024-09-17T04:34:26.565 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-17T04:34:26.616 INFO:tasks.ceph:setting config [mds] mds_bal_split_bits = 3 2024-09-17T04:34:26.617 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mds mds_bal_split_bits 3 2024-09-17T04:34:26.667 INFO:tasks.ceph:setting config [mds] mds_bal_split_size = 100 2024-09-17T04:34:26.667 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mds mds_bal_split_size 100 2024-09-17T04:34:26.703 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-17T04:34:26.703 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-17T04:34:26.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.711+0000 7f48fb7fe640 1 -- 172.21.15.43:0/258799575 <== mon.1 v2:172.21.15.62:3300/0 10 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v4)=0 v4) ==== 109+0+0 (secure 0 0 0) 0x7f48fc03ebe0 con 0x7f490414a340 2024-09-17T04:34:26.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.715+0000 7f4908d13640 1 -- 172.21.15.43:0/258799575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f490414a340 msgr2=0x7f49040c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:26.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.715+0000 7f4908d13640 1 --2- 172.21.15.43:0/258799575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f490414a340 0x7f49040c80f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f48fc031000 tx=0x7f48fc004ab0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.724 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-17T04:34:26.724 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-17T04:34:26.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.717+0000 7fc5545ff640 1 -- 172.21.15.43:0/3078440213 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fc528005310 con 0x7fc54c15bfe0 2024-09-17T04:34:26.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.718+0000 7f4908d13640 1 -- 172.21.15.43:0/258799575 shutdown_connections 2024-09-17T04:34:26.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.718+0000 7f4908d13640 1 --2- 172.21.15.43:0/258799575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f490414a340 0x7f49040c80f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.718+0000 7f4908d13640 1 --2- 172.21.15.43:0/258799575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4904149f30 0x7f49040c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.718+0000 7f4908d13640 1 --2- 172.21.15.43:0/258799575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48f0004d40 0x7f4904154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.718+0000 7f4908d13640 1 -- 172.21.15.43:0/258799575 >> 172.21.15.43:0/258799575 conn(0x7f490406cdb0 msgr2=0x7f490414f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:26.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.718+0000 7f12cac7e640 1 -- 172.21.15.43:0/2267297938 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f129c005310 con 0x7f12c40b4ba0 2024-09-17T04:34:26.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.723+0000 7f4908d13640 1 -- 172.21.15.43:0/258799575 shutdown_connections 2024-09-17T04:34:26.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.723+0000 7f4908d13640 1 -- 172.21.15.43:0/258799575 wait complete. 2024-09-17T04:34:26.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.731+0000 7fc542ffd640 1 -- 172.21.15.43:0/3078440213 <== mon.0 v2:172.21.15.43:3300/0 10 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7fc54401fbe0 con 0x7fc54c15bfe0 2024-09-17T04:34:26.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.732+0000 7fc540ff9640 1 -- 172.21.15.43:0/3078440213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc54c15bfe0 msgr2=0x7fc54c1522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:26.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.732+0000 7fc540ff9640 1 --2- 172.21.15.43:0/3078440213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc54c15bfe0 0x7fc54c1522e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc54c074620 tx=0x7fc54400ed20 comp rx=0 tx=0).stop 2024-09-17T04:34:26.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.733+0000 7f9178ff9640 1 -- 172.21.15.43:0/562863480 <== mon.2 v2:172.21.15.62:3301/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f9170009d90 con 0x7f917c0c8290 2024-09-17T04:34:26.735 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-17T04:34:26.735 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-17T04:34:26.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.734+0000 7fc540ff9640 1 -- 172.21.15.43:0/3078440213 shutdown_connections 2024-09-17T04:34:26.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.734+0000 7fc540ff9640 1 --2- 172.21.15.43:0/3078440213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc54c15bbd0 0x7fc54c1ff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.734+0000 7f12c17fa640 1 -- 172.21.15.43:0/2267297938 <== mon.2 v2:172.21.15.62:3301/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f12b8010a30 con 0x7f12c40b4ba0 2024-09-17T04:34:26.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.734+0000 7fc540ff9640 1 --2- 172.21.15.43:0/3078440213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc54c15bfe0 0x7fc54c1522e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.734+0000 7fc540ff9640 1 --2- 172.21.15.43:0/3078440213 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc538003b10 0x7fc54c06e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.734+0000 7fc540ff9640 1 -- 172.21.15.43:0/3078440213 >> 172.21.15.43:0/3078440213 conn(0x7fc54c0cef30 msgr2=0x7fc54c150b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:26.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.736+0000 7f2653fff640 1 -- 172.21.15.43:0/3351151446 <== mon.0 v2:172.21.15.43:3300/0 8 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f266400acc0 con 0x7f266c074ad0 2024-09-17T04:34:26.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.740+0000 7f283757b640 1 -- 172.21.15.43:0/742906331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28300735d0 msgr2=0x7f2830155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:26.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.740+0000 7f283757b640 1 --2- 172.21.15.43:0/742906331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28300735d0 0x7f2830155a00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f28300700c0 tx=0x7f282802aa30 comp rx=0 tx=0).stop 2024-09-17T04:34:26.743 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-17T04:34:26.743 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-17T04:34:26.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.741+0000 7f283757b640 1 -- 172.21.15.43:0/742906331 shutdown_connections 2024-09-17T04:34:26.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.741+0000 7f283757b640 1 --2- 172.21.15.43:0/742906331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28300735d0 0x7f2830155a00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.741+0000 7f283757b640 1 --2- 172.21.15.43:0/742906331 >> v2:172.21.15.62:3300/0 conn(0x7f2830072670 0x7f283015f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.741+0000 7f283757b640 1 -- 172.21.15.43:0/742906331 >> 172.21.15.43:0/742906331 conn(0x7f28300c95e0 msgr2=0x7f28300c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:26.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.743+0000 7f12c17fa640 1 -- 172.21.15.43:0/2267297938 <== mon.2 v2:172.21.15.62:3301/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12b8024670 con 0x7f12c40b4ba0 2024-09-17T04:34:26.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.743+0000 7f12c17fa640 1 -- 172.21.15.43:0/2267297938 <== mon.2 v2:172.21.15.62:3301/0 12 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f12b8024aa0 con 0x7f12c40b4ba0 2024-09-17T04:34:26.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.741+0000 7f9178ff9640 1 -- 172.21.15.43:0/562863480 <== mon.2 v2:172.21.15.62:3301/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91700035f0 con 0x7f917c0c8290 2024-09-17T04:34:26.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.745+0000 7fc540ff9640 1 -- 172.21.15.43:0/3078440213 shutdown_connections 2024-09-17T04:34:26.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.745+0000 7fc540ff9640 1 -- 172.21.15.43:0/3078440213 wait complete. 2024-09-17T04:34:26.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.746+0000 7f12aaffd640 1 -- 172.21.15.43:0/2267297938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12c40b4ba0 msgr2=0x7f12c41fe720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:26.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.746+0000 7f12aaffd640 1 --2- 172.21.15.43:0/2267297938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12c40b4ba0 0x7f12c41fe720 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f12b8001110 tx=0x7f12b8001510 comp rx=0 tx=0).stop 2024-09-17T04:34:26.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.747+0000 7f12aaffd640 1 -- 172.21.15.43:0/2267297938 shutdown_connections 2024-09-17T04:34:26.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.747+0000 7f12aaffd640 1 --2- 172.21.15.43:0/2267297938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12c4202280 0x7f12c41fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.747+0000 7f12aaffd640 1 --2- 172.21.15.43:0/2267297938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12c40b4ba0 0x7f12c41fe720 secure :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f12b8001110 tx=0x7f12b8001510 comp rx=0 tx=0).stop 2024-09-17T04:34:26.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.747+0000 7f12aaffd640 1 --2- 172.21.15.43:0/2267297938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12c40b4790 0x7f12c42018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.747+0000 7f12aaffd640 1 -- 172.21.15.43:0/2267297938 >> 172.21.15.43:0/2267297938 conn(0x7f12c406f120 msgr2=0x7f12c415ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:26.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.747+0000 7f2653fff640 1 -- 172.21.15.43:0/3351151446 <== mon.0 v2:172.21.15.43:3300/0 9 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2664010480 con 0x7f266c074ad0 2024-09-17T04:34:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.744+0000 7f283757b640 1 -- 172.21.15.43:0/742906331 shutdown_connections 2024-09-17T04:34:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.744+0000 7f283757b640 1 -- 172.21.15.43:0/742906331 wait complete. 2024-09-17T04:34:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.747+0000 7f283757b640 1 Processor -- start 2024-09-17T04:34:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.747+0000 7f283757b640 1 -- start start 2024-09-17T04:34:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.749+0000 7f283757b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28300735d0 0x7f283014d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:26.753 INFO:tasks.ceph:setting config [mds] mds_dir_prefetch = True 2024-09-17T04:34:26.753 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mds mds_dir_prefetch True 2024-09-17T04:34:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.750+0000 7f283757b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28300c83c0 0x7f283014eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.750+0000 7f2834b16640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28300c83c0 0x7f283014eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.750+0000 7f2834b16640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28300c83c0 0x7f283014eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34024/0 (socket says 172.21.15.43:34024) 2024-09-17T04:34:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.750+0000 7f2835317640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28300735d0 0x7f283014d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.750+0000 7f2835317640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28300735d0 0x7f283014d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:44498/0 (socket says 172.21.15.43:44498) 2024-09-17T04:34:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.750+0000 7f2834b16640 1 -- 172.21.15.43:0/2281385847 learned_addr learned my addr 172.21.15.43:0/2281385847 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.750+0000 7f283757b640 1 --2- 172.21.15.43:0/2281385847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28300c87d0 0x7f28301f8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.750+0000 7f283757b640 1 -- 172.21.15.43:0/2281385847 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f283006df40 con 0x7f28300c83c0 2024-09-17T04:34:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.750+0000 7f283757b640 1 -- 172.21.15.43:0/2281385847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f283006ddc0 con 0x7f28300c87d0 2024-09-17T04:34:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.750+0000 7f283757b640 1 -- 172.21.15.43:0/2281385847 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f283006e0c0 con 0x7f28300735d0 2024-09-17T04:34:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.751+0000 7f2834b16640 1 -- 172.21.15.43:0/2281385847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28300735d0 msgr2=0x7f283014d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.751+0000 7f2834b16640 1 --2- 172.21.15.43:0/2281385847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28300735d0 0x7f283014d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.751+0000 7f2834b16640 1 -- 172.21.15.43:0/2281385847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28300c87d0 msgr2=0x7f28301f8390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:34:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.751+0000 7f2834b16640 1 --2- 172.21.15.43:0/2281385847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28300c87d0 0x7f28301f8390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.751+0000 7f2834b16640 1 -- 172.21.15.43:0/2281385847 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283014dc60 con 0x7f28300c83c0 2024-09-17T04:34:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.751+0000 7f2834b16640 1 --2- 172.21.15.43:0/2281385847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28300c83c0 0x7f283014eca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f282c00b7b0 tx=0x7f282c00bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.752+0000 7f2835317640 1 --2- 172.21.15.43:0/2281385847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28300735d0 0x7f283014d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:34:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.753+0000 7f2825ffb640 1 -- 172.21.15.43:0/2281385847 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c019070 con 0x7f28300c83c0 2024-09-17T04:34:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.753+0000 7f283757b640 1 -- 172.21.15.43:0/2281385847 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28300c69b0 con 0x7f28300c83c0 2024-09-17T04:34:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.754+0000 7f283757b640 1 -- 172.21.15.43:0/2281385847 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f283014cc10 con 0x7f28300c83c0 2024-09-17T04:34:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.754+0000 7f2825ffb640 1 -- 172.21.15.43:0/2281385847 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f282c00c830 con 0x7f28300c83c0 2024-09-17T04:34:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.754+0000 7f2825ffb640 1 -- 172.21.15.43:0/2281385847 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c00cc80 con 0x7f28300c83c0 2024-09-17T04:34:26.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.757+0000 7f12aaffd640 1 -- 172.21.15.43:0/2267297938 shutdown_connections 2024-09-17T04:34:26.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.757+0000 7f12aaffd640 1 -- 172.21.15.43:0/2267297938 wait complete. 2024-09-17T04:34:26.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.756+0000 7f2825ffb640 1 -- 172.21.15.43:0/2281385847 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f282c01c070 con 0x7f28300c83c0 2024-09-17T04:34:26.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.756+0000 7f2825ffb640 1 -- 172.21.15.43:0/2281385847 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f282c01d8c0 con 0x7f28300c83c0 2024-09-17T04:34:26.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.758+0000 7f283757b640 1 -- 172.21.15.43:0/2281385847 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2810005290 con 0x7f28300c83c0 2024-09-17T04:34:26.765 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-17T04:34:26.765 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-17T04:34:26.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.762+0000 7f2825ffb640 1 -- 172.21.15.43:0/2281385847 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f282c01dac0 con 0x7f28300c83c0 2024-09-17T04:34:26.784 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-17T04:34:26.785 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-17T04:34:26.806 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-17T04:34:26.806 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-17T04:34:26.850 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-17T04:34:26.850 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-17T04:34:26.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.879+0000 7f6344539640 1 -- 172.21.15.43:0/1789988141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f633c072670 msgr2=0x7f633c06dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:26.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.879+0000 7f6344539640 1 --2- 172.21.15.43:0/1789988141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f633c072670 0x7f633c06dfa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6334005fd0 tx=0x7f633402a560 comp rx=0 tx=0).stop 2024-09-17T04:34:26.882 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-17T04:34:26.882 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-17T04:34:26.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.883+0000 7f6344539640 1 -- 172.21.15.43:0/1789988141 shutdown_connections 2024-09-17T04:34:26.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.883+0000 7f6344539640 1 --2- 172.21.15.43:0/1789988141 >> v2:172.21.15.62:3300/0 conn(0x7f633c0735d0 0x7f633c073b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.883+0000 7f6344539640 1 --2- 172.21.15.43:0/1789988141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f633c072670 0x7f633c06dfa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.883+0000 7f6344539640 1 -- 172.21.15.43:0/1789988141 >> 172.21.15.43:0/1789988141 conn(0x7f633c0c95e0 msgr2=0x7f633c0c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:26.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.884+0000 7f6344539640 1 -- 172.21.15.43:0/1789988141 shutdown_connections 2024-09-17T04:34:26.889 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-17T04:34:26.890 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-17T04:34:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.884+0000 7f6344539640 1 -- 172.21.15.43:0/1789988141 wait complete. 2024-09-17T04:34:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.887+0000 7f6344539640 1 Processor -- start 2024-09-17T04:34:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.887+0000 7f6344539640 1 -- start start 2024-09-17T04:34:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.890+0000 7f6344539640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f633c072670 0x7f633c147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.890+0000 7f6344539640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f633c0735d0 0x7f633c144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.890+0000 7f63422d5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f633c072670 0x7f633c147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.890+0000 7f63422d5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f633c072670 0x7f633c147b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34040/0 (socket says 172.21.15.43:34040) 2024-09-17T04:34:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.890+0000 7f63422d5640 1 -- 172.21.15.43:0/1751444631 learned_addr learned my addr 172.21.15.43:0/1751444631 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.891+0000 7f6341ad4640 1 --2- 172.21.15.43:0/1751444631 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f633c0735d0 0x7f633c144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.891+0000 7f6344539640 1 --2- 172.21.15.43:0/1751444631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f633c15cce0 0x7f633c073a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.891+0000 7f6344539640 1 -- 172.21.15.43:0/1751444631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f633c15c470 con 0x7f633c072670 2024-09-17T04:34:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.891+0000 7f6344539640 1 -- 172.21.15.43:0/1751444631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f633c15c2f0 con 0x7f633c15cce0 2024-09-17T04:34:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.891+0000 7f6342ad6640 1 --2- 172.21.15.43:0/1751444631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f633c15cce0 0x7f633c073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.891+0000 7f6344539640 1 -- 172.21.15.43:0/1751444631 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f633c15c5f0 con 0x7f633c0735d0 2024-09-17T04:34:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.896+0000 7f6342ad6640 1 -- 172.21.15.43:0/1751444631 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f633c0735d0 msgr2=0x7f633c144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.896+0000 7f6342ad6640 1 --2- 172.21.15.43:0/1751444631 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f633c0735d0 0x7f633c144810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.896+0000 7f6342ad6640 1 -- 172.21.15.43:0/1751444631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f633c072670 msgr2=0x7f633c147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.896+0000 7f6342ad6640 1 --2- 172.21.15.43:0/1751444631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f633c072670 0x7f633c147b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.896+0000 7f6342ad6640 1 -- 172.21.15.43:0/1751444631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633c0cc7f0 con 0x7f633c15cce0 2024-09-17T04:34:26.901 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-17T04:34:26.901 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-17T04:34:26.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.900+0000 7f6342ad6640 1 --2- 172.21.15.43:0/1751444631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f633c15cce0 0x7f633c073a40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f633c0c95b0 tx=0x7f633000cba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.904+0000 7f633affd640 1 -- 172.21.15.43:0/1751444631 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330004220 con 0x7f633c15cce0 2024-09-17T04:34:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.904+0000 7f633affd640 1 -- 172.21.15.43:0/1751444631 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63300077a0 con 0x7f633c15cce0 2024-09-17T04:34:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.904+0000 7f6344539640 1 -- 172.21.15.43:0/1751444631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633c1f5c20 con 0x7f633c15cce0 2024-09-17T04:34:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.904+0000 7f6344539640 1 -- 172.21.15.43:0/1751444631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f633c14af10 con 0x7f633c15cce0 2024-09-17T04:34:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.905+0000 7f633affd640 1 -- 172.21.15.43:0/1751444631 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330007bf0 con 0x7f633c15cce0 2024-09-17T04:34:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.907+0000 7f633affd640 1 -- 172.21.15.43:0/1751444631 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6330003980 con 0x7f633c15cce0 2024-09-17T04:34:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.907+0000 7f633affd640 1 -- 172.21.15.43:0/1751444631 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f633000fb20 con 0x7f633c15cce0 2024-09-17T04:34:26.908 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-17T04:34:26.909 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-17T04:34:26.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.909+0000 7f6338ff9640 1 -- 172.21.15.43:0/1751444631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f631c005290 con 0x7f633c15cce0 2024-09-17T04:34:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.913+0000 7f633affd640 1 -- 172.21.15.43:0/1751444631 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f633c0cc7f0 con 0x7f633c15cce0 2024-09-17T04:34:26.917 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-17T04:34:26.917 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-17T04:34:26.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.949+0000 7f65c8e30640 1 -- 172.21.15.43:0/1438311566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65bc0071e0 msgr2=0x7f65bc0f6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:26.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.949+0000 7f65c8e30640 1 --2- 172.21.15.43:0/1438311566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65bc0071e0 0x7f65bc0f6810 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f65c40524b0 tx=0x7f65c4096850 comp rx=0 tx=0).stop 2024-09-17T04:34:26.954 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-17T04:34:26.954 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-17T04:34:26.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.951+0000 7f65c8e30640 1 -- 172.21.15.43:0/1438311566 shutdown_connections 2024-09-17T04:34:26.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.951+0000 7f65c8e30640 1 --2- 172.21.15.43:0/1438311566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65bc0071e0 0x7f65bc0f6810 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.951+0000 7f65c8e30640 1 --2- 172.21.15.43:0/1438311566 >> v2:172.21.15.62:3300/0 conn(0x7f65bc04c180 0x7f65bc034300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.951+0000 7f65c8e30640 1 -- 172.21.15.43:0/1438311566 >> 172.21.15.43:0/1438311566 conn(0x7f65bc04fe30 msgr2=0x7f65bc050240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:26.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.954+0000 7f65c8e30640 1 -- 172.21.15.43:0/1438311566 shutdown_connections 2024-09-17T04:34:26.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.954+0000 7f65c8e30640 1 -- 172.21.15.43:0/1438311566 wait complete. 2024-09-17T04:34:26.963 DEBUG:tasks.ceph:set 27 configs 2024-09-17T04:34:26.963 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi043') 2024-09-17T04:34:26.964 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi043') 2024-09-17T04:34:26.964 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi043') 2024-09-17T04:34:26.964 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi043') 2024-09-17T04:34:26.964 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi043') 2024-09-17T04:34:26.964 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi043') 2024-09-17T04:34:26.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.957+0000 7f65c8e30640 1 Processor -- start 2024-09-17T04:34:26.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.957+0000 7f65c8e30640 1 -- start start 2024-09-17T04:34:26.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.959+0000 7f65c8e30640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65bc0071e0 0x7f65bc0f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:26.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.960+0000 7f65c8e30640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65bc04c180 0x7f65bc10e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:26.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.960+0000 7f65c8e30640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65bc0ffda0 0x7f65bc0db750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:26.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.960+0000 7f65c8e30640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc0f6ed0 con 0x7f65bc0071e0 2024-09-17T04:34:26.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.960+0000 7f65c1d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65bc04c180 0x7f65bc10e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:26.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.960+0000 7f65c1d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65bc04c180 0x7f65bc10e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:37214/0 (socket says 172.21.15.43:37214) 2024-09-17T04:34:26.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.960+0000 7f65c1d9b640 1 -- 172.21.15.43:0/2050923226 learned_addr learned my addr 172.21.15.43:0/2050923226 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:26.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.960+0000 7f65c2d9d640 1 --2- 172.21.15.43:0/2050923226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65bc0ffda0 0x7f65bc0db750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:26.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.960+0000 7f65c8e30640 1 -- 172.21.15.43:0/2050923226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc0f6d50 con 0x7f65bc04c180 2024-09-17T04:34:26.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.960+0000 7f65c8e30640 1 -- 172.21.15.43:0/2050923226 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f65bc04bba0 con 0x7f65bc0ffda0 2024-09-17T04:34:26.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.960+0000 7f65c259c640 1 --2- 172.21.15.43:0/2050923226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65bc0071e0 0x7f65bc0f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:26.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.961+0000 7f65c1d9b640 1 -- 172.21.15.43:0/2050923226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65bc0ffda0 msgr2=0x7f65bc0db750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:26.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.961+0000 7f65c1d9b640 1 --2- 172.21.15.43:0/2050923226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65bc0ffda0 0x7f65bc0db750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.964+0000 7f65c1d9b640 1 -- 172.21.15.43:0/2050923226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65bc0071e0 msgr2=0x7f65bc0f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:26.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.964+0000 7f65c1d9b640 1 --2- 172.21.15.43:0/2050923226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65bc0071e0 0x7f65bc0f24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.964+0000 7f65c1d9b640 1 -- 172.21.15.43:0/2050923226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65bc10e540 con 0x7f65bc04c180 2024-09-17T04:34:26.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.964+0000 7f65c1d9b640 1 --2- 172.21.15.43:0/2050923226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65bc04c180 0x7f65bc10e000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f65c4052860 tx=0x7f65c409e610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:26.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.966+0000 7f65b2ffd640 1 -- 172.21.15.43:0/2050923226 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c40a8850 con 0x7f65bc04c180 2024-09-17T04:34:26.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.966+0000 7f65b2ffd640 1 -- 172.21.15.43:0/2050923226 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65c40a8ae0 con 0x7f65bc04c180 2024-09-17T04:34:26.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.966+0000 7f65b2ffd640 1 -- 172.21.15.43:0/2050923226 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c40a73a0 con 0x7f65bc04c180 2024-09-17T04:34:26.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.966+0000 7f65c8e30640 1 -- 172.21.15.43:0/2050923226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65bc10db00 con 0x7f65bc04c180 2024-09-17T04:34:26.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.966+0000 7f65c8e30640 1 -- 172.21.15.43:0/2050923226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65bc0f0f00 con 0x7f65bc04c180 2024-09-17T04:34:26.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.968+0000 7f65b2ffd640 1 -- 172.21.15.43:0/2050923226 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f65c40b4060 con 0x7f65bc04c180 2024-09-17T04:34:26.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.968+0000 7f65b2ffd640 1 -- 172.21.15.43:0/2050923226 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f65c40b6a90 con 0x7f65bc04c180 2024-09-17T04:34:26.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.981+0000 7f91829da640 1 -- 172.21.15.43:0/562863480 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f9154001690 con 0x7f917c0c8290 2024-09-17T04:34:26.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.986+0000 7f9178ff9640 1 -- 172.21.15.43:0/562863480 <== mon.2 v2:172.21.15.62:3301/0 12 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7f9170003910 con 0x7f917c0c8290 2024-09-17T04:34:26.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.989+0000 7f91627fc640 1 -- 172.21.15.43:0/562863480 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f917c0c8290 msgr2=0x7f917c15b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:26.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.989+0000 7f91627fc640 1 --2- 172.21.15.43:0/562863480 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f917c0c8290 0x7f917c15b9a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f917000d690 tx=0x7f917000db50 comp rx=0 tx=0).stop 2024-09-17T04:34:26.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.990+0000 7f91627fc640 1 -- 172.21.15.43:0/562863480 shutdown_connections 2024-09-17T04:34:26.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.990+0000 7f91627fc640 1 --2- 172.21.15.43:0/562863480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f917c15f0f0 0x7f917c14d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.990+0000 7f91627fc640 1 --2- 172.21.15.43:0/562863480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f917c150f20 0x7f917c1f0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.990+0000 7f91627fc640 1 --2- 172.21.15.43:0/562863480 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f917c0c8290 0x7f917c15b9a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:26.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.990+0000 7f91627fc640 1 -- 172.21.15.43:0/562863480 >> 172.21.15.43:0/562863480 conn(0x7f917c06cdb0 msgr2=0x7f917c0c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:26.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.990+0000 7f91627fc640 1 -- 172.21.15.43:0/562863480 shutdown_connections 2024-09-17T04:34:26.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.990+0000 7f91627fc640 1 -- 172.21.15.43:0/562863480 wait complete. 2024-09-17T04:34:26.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.969+0000 7f65c259c640 1 --2- 172.21.15.43:0/2050923226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65bc0071e0 0x7f65bc0f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:34:26.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.992+0000 7f65c8e30640 1 -- 172.21.15.43:0/2050923226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a8005290 con 0x7f65bc04c180 2024-09-17T04:34:26.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:26.996+0000 7f65b2ffd640 1 -- 172.21.15.43:0/2050923226 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f65c409e920 con 0x7f65bc04c180 2024-09-17T04:34:27.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.009+0000 7f303fb6e640 1 -- 172.21.15.43:0/3132129932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f303806ddc0 msgr2=0x7f303806e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.009+0000 7f303fb6e640 1 --2- 172.21.15.43:0/3132129932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f303806ddc0 0x7f303806e1d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f30380c46c0 tx=0x7f302803b0f0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.009+0000 7f303fb6e640 1 -- 172.21.15.43:0/3132129932 shutdown_connections 2024-09-17T04:34:27.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.009+0000 7f303fb6e640 1 --2- 172.21.15.43:0/3132129932 >> v2:172.21.15.43:3300/0 conn(0x7f30380c47a0 0x7f30380c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.009+0000 7f303fb6e640 1 --2- 172.21.15.43:0/3132129932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f303806ddc0 0x7f303806e1d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.009+0000 7f303fb6e640 1 -- 172.21.15.43:0/3132129932 >> 172.21.15.43:0/3132129932 conn(0x7f30380c95e0 msgr2=0x7f30380c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.009+0000 7f303fb6e640 1 -- 172.21.15.43:0/3132129932 shutdown_connections 2024-09-17T04:34:27.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.009+0000 7f303fb6e640 1 -- 172.21.15.43:0/3132129932 wait complete. 2024-09-17T04:34:27.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.012+0000 7f303fb6e640 1 Processor -- start 2024-09-17T04:34:27.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.012+0000 7f303fb6e640 1 -- start start 2024-09-17T04:34:27.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.015+0000 7f303fb6e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f303806ddc0 0x7f3038164200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.015+0000 7f303fb6e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3038072670 0x7f3038167370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.015+0000 7f303d90a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f303806ddc0 0x7f3038164200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.015+0000 7f303d90a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f303806ddc0 0x7f3038164200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:37234/0 (socket says 172.21.15.43:37234) 2024-09-17T04:34:27.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.015+0000 7f303d90a640 1 -- 172.21.15.43:0/4062900729 learned_addr learned my addr 172.21.15.43:0/4062900729 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.015+0000 7f303fb6e640 1 --2- 172.21.15.43:0/4062900729 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30380c47a0 0x7f3038161f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.015+0000 7f303d109640 1 --2- 172.21.15.43:0/4062900729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3038072670 0x7f3038167370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.015+0000 7f303fb6e640 1 -- 172.21.15.43:0/4062900729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30380ca4c0 con 0x7f3038072670 2024-09-17T04:34:27.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.015+0000 7f303fb6e640 1 -- 172.21.15.43:0/4062900729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3038073300 con 0x7f303806ddc0 2024-09-17T04:34:27.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.015+0000 7f303fb6e640 1 -- 172.21.15.43:0/4062900729 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3038074890 con 0x7f30380c47a0 2024-09-17T04:34:27.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.015+0000 7f303e10b640 1 --2- 172.21.15.43:0/4062900729 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30380c47a0 0x7f3038161f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.019+0000 7f303d109640 1 -- 172.21.15.43:0/4062900729 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30380c47a0 msgr2=0x7f3038161f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.019+0000 7f303d109640 1 --2- 172.21.15.43:0/4062900729 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30380c47a0 0x7f3038161f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.019+0000 7f303d109640 1 -- 172.21.15.43:0/4062900729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f303806ddc0 msgr2=0x7f3038164200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.019+0000 7f303d109640 1 --2- 172.21.15.43:0/4062900729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f303806ddc0 0x7f3038164200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.019+0000 7f303d109640 1 -- 172.21.15.43:0/4062900729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30381f2110 con 0x7f3038072670 2024-09-17T04:34:27.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.020+0000 7f303d109640 1 --2- 172.21.15.43:0/4062900729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3038072670 0x7f3038167370 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3028041000 tx=0x7f3028011150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.027+0000 7f2651ffb640 1 -- 172.21.15.43:0/3351151446 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f266c1f9860 con 0x7f266c074ad0 2024-09-17T04:34:27.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.034+0000 7f2653fff640 1 -- 172.21.15.43:0/3351151446 <== mon.0 v2:172.21.15.43:3300/0 10 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f2664010630 con 0x7f266c074ad0 2024-09-17T04:34:27.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.035+0000 7f302e7fc640 1 -- 172.21.15.43:0/4062900729 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028011750 con 0x7f3038072670 2024-09-17T04:34:27.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.035+0000 7f302e7fc640 1 -- 172.21.15.43:0/4062900729 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30280035f0 con 0x7f3038072670 2024-09-17T04:34:27.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.035+0000 7f302e7fc640 1 -- 172.21.15.43:0/4062900729 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028003a40 con 0x7f3038072670 2024-09-17T04:34:27.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.035+0000 7f303fb6e640 1 -- 172.21.15.43:0/4062900729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3038164740 con 0x7f3038072670 2024-09-17T04:34:27.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.035+0000 7f303fb6e640 1 -- 172.21.15.43:0/4062900729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f303806d7a0 con 0x7f3038072670 2024-09-17T04:34:27.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.037+0000 7f301bfff640 1 -- 172.21.15.43:0/4062900729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30380c8d90 con 0x7f3038072670 2024-09-17T04:34:27.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.043+0000 7f302e7fc640 1 -- 172.21.15.43:0/4062900729 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f302800f9d0 con 0x7f3038072670 2024-09-17T04:34:27.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.043+0000 7f302e7fc640 1 -- 172.21.15.43:0/4062900729 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f302801d400 con 0x7f3038072670 2024-09-17T04:34:27.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.043+0000 7f302e7fc640 1 -- 172.21.15.43:0/4062900729 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f30380c8d90 con 0x7f3038072670 2024-09-17T04:34:27.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.054+0000 7f2651ffb640 1 -- 172.21.15.43:0/3351151446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f266c074ad0 msgr2=0x7f266c156690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.054+0000 7f2651ffb640 1 --2- 172.21.15.43:0/3351151446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f266c074ad0 0x7f266c156690 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f266400c9f0 tx=0x7f266400ceb0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.054+0000 7f2651ffb640 1 -- 172.21.15.43:0/3351151446 shutdown_connections 2024-09-17T04:34:27.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.054+0000 7f2651ffb640 1 --2- 172.21.15.43:0/3351151446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f266c1515b0 0x7f266c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.054+0000 7f2651ffb640 1 --2- 172.21.15.43:0/3351151446 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f266c15bee0 0x7f266c14d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.054+0000 7f2651ffb640 1 --2- 172.21.15.43:0/3351151446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f266c074ad0 0x7f266c156690 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.054+0000 7f2651ffb640 1 -- 172.21.15.43:0/3351151446 >> 172.21.15.43:0/3351151446 conn(0x7f266c071a00 msgr2=0x7f266c14e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.054+0000 7f2651ffb640 1 -- 172.21.15.43:0/3351151446 shutdown_connections 2024-09-17T04:34:27.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.054+0000 7f2651ffb640 1 -- 172.21.15.43:0/3351151446 wait complete. 2024-09-17T04:34:27.068 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.104+0000 7f283757b640 1 -- 172.21.15.43:0/2281385847 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f2810005850 con 0x7f28300c83c0 2024-09-17T04:34:27.105 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.109+0000 7f2825ffb640 1 -- 172.21.15.43:0/2281385847 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7f282c01dca0 con 0x7f28300c83c0 2024-09-17T04:34:27.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.111+0000 7f281b7fe640 1 -- 172.21.15.43:0/2281385847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28300c83c0 msgr2=0x7f283014eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.111+0000 7f281b7fe640 1 --2- 172.21.15.43:0/2281385847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28300c83c0 0x7f283014eca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f282c00b7b0 tx=0x7f282c00bc70 comp rx=0 tx=0).stop 2024-09-17T04:34:27.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.111+0000 7f281b7fe640 1 -- 172.21.15.43:0/2281385847 shutdown_connections 2024-09-17T04:34:27.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.111+0000 7f281b7fe640 1 --2- 172.21.15.43:0/2281385847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28300c87d0 0x7f28301f8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.111+0000 7f281b7fe640 1 --2- 172.21.15.43:0/2281385847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28300c83c0 0x7f283014eca0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.111+0000 7f281b7fe640 1 --2- 172.21.15.43:0/2281385847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28300735d0 0x7f283014d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.112+0000 7f281b7fe640 1 -- 172.21.15.43:0/2281385847 >> 172.21.15.43:0/2281385847 conn(0x7f28300c95e0 msgr2=0x7f28300c31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.112+0000 7f281b7fe640 1 -- 172.21.15.43:0/2281385847 shutdown_connections 2024-09-17T04:34:27.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.112+0000 7f281b7fe640 1 -- 172.21.15.43:0/2281385847 wait complete. 2024-09-17T04:34:27.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.153+0000 7fdf726f9640 1 -- 172.21.15.43:0/4203810748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6c0b2f50 msgr2=0x7fdf6c0c20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.153+0000 7fdf726f9640 1 --2- 172.21.15.43:0/4203810748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6c0b2f50 0x7fdf6c0c20a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0c5720 tx=0x7fdf6402cd10 comp rx=0 tx=0).stop 2024-09-17T04:34:27.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.155+0000 7fdf726f9640 1 -- 172.21.15.43:0/4203810748 shutdown_connections 2024-09-17T04:34:27.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.155+0000 7fdf726f9640 1 --2- 172.21.15.43:0/4203810748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6c0b2f50 0x7fdf6c0c20a0 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0c5720 tx=0x7fdf6402cd10 comp rx=0 tx=0).stop 2024-09-17T04:34:27.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.155+0000 7fdf726f9640 1 --2- 172.21.15.43:0/4203810748 >> v2:172.21.15.62:3300/0 conn(0x7fdf6c16be00 0x7fdf6c16c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.155+0000 7fdf726f9640 1 --2- 172.21.15.43:0/4203810748 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf6c0c7560 0x7fdf6c070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.155+0000 7fdf726f9640 1 -- 172.21.15.43:0/4203810748 >> 172.21.15.43:0/4203810748 conn(0x7fdf6c0c9660 msgr2=0x7fdf6c0c9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.161+0000 7fdf726f9640 1 -- 172.21.15.43:0/4203810748 shutdown_connections 2024-09-17T04:34:27.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.161+0000 7fdf726f9640 1 -- 172.21.15.43:0/4203810748 wait complete. 2024-09-17T04:34:27.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.164+0000 7fdf726f9640 1 Processor -- start 2024-09-17T04:34:27.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.165+0000 7fdf726f9640 1 -- start start 2024-09-17T04:34:27.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.167+0000 7fdf726f9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6c0c7560 0x7fdf6c0caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.168+0000 7fdf726f9640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf6c16be00 0x7fdf6c0c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.168+0000 7fdf6bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6c0c7560 0x7fdf6c0caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.168+0000 7fdf6bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6c0c7560 0x7fdf6c0caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34074/0 (socket says 172.21.15.43:34074) 2024-09-17T04:34:27.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.168+0000 7fdf6bfff640 1 -- 172.21.15.43:0/1336206779 learned_addr learned my addr 172.21.15.43:0/1336206779 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.168+0000 7fdf6b7fe640 1 --2- 172.21.15.43:0/1336206779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf6c16be00 0x7fdf6c0c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.168+0000 7fdf726f9640 1 --2- 172.21.15.43:0/1336206779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf6c20a2c0 0x7fdf6c20a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.169 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.169+0000 7fdf70c96640 1 --2- 172.21.15.43:0/1336206779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf6c20a2c0 0x7fdf6c20a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.169+0000 7fdf726f9640 1 -- 172.21.15.43:0/1336206779 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6c0c5220 con 0x7fdf6c0c7560 2024-09-17T04:34:27.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.169+0000 7fdf726f9640 1 -- 172.21.15.43:0/1336206779 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6c0c2db0 con 0x7fdf6c20a2c0 2024-09-17T04:34:27.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.169+0000 7fdf726f9640 1 -- 172.21.15.43:0/1336206779 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdf6c0c2a70 con 0x7fdf6c16be00 2024-09-17T04:34:27.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.170+0000 7fdf6bfff640 1 -- 172.21.15.43:0/1336206779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf6c16be00 msgr2=0x7fdf6c0c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.170+0000 7fdf6bfff640 1 --2- 172.21.15.43:0/1336206779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf6c16be00 0x7fdf6c0c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.170+0000 7fdf6bfff640 1 -- 172.21.15.43:0/1336206779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf6c20a2c0 msgr2=0x7fdf6c20a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.170+0000 7fdf6bfff640 1 --2- 172.21.15.43:0/1336206779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf6c20a2c0 0x7fdf6c20a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.170+0000 7fdf6bfff640 1 -- 172.21.15.43:0/1336206779 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6c0cafa0 con 0x7fdf6c0c7560 2024-09-17T04:34:27.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.170+0000 7fdf6bfff640 1 --2- 172.21.15.43:0/1336206779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6c0c7560 0x7fdf6c0caa60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c00ea00 tx=0x7fdf5c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.170+0000 7fdf6b7fe640 1 --2- 172.21.15.43:0/1336206779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf6c16be00 0x7fdf6c0c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:34:27.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.170+0000 7fdf70c96640 1 --2- 172.21.15.43:0/1336206779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf6c20a2c0 0x7fdf6c20a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:34:27.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.171+0000 7fdf68ff9640 1 -- 172.21.15.43:0/1336206779 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c00cdc0 con 0x7fdf6c0c7560 2024-09-17T04:34:27.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.171+0000 7fdf68ff9640 1 -- 172.21.15.43:0/1336206779 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf5c005020 con 0x7fdf6c0c7560 2024-09-17T04:34:27.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.171+0000 7fdf726f9640 1 -- 172.21.15.43:0/1336206779 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf6c0cc830 con 0x7fdf6c0c7560 2024-09-17T04:34:27.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.171+0000 7fdf726f9640 1 -- 172.21.15.43:0/1336206779 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf6c15c0b0 con 0x7fdf6c0c7560 2024-09-17T04:34:27.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.173+0000 7fdf68ff9640 1 -- 172.21.15.43:0/1336206779 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c005410 con 0x7fdf6c0c7560 2024-09-17T04:34:27.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.174+0000 7fdf527fc640 1 -- 172.21.15.43:0/1336206779 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf4c005290 con 0x7fdf6c0c7560 2024-09-17T04:34:27.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.176+0000 7fdf68ff9640 1 -- 172.21.15.43:0/1336206779 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdf5c0047a0 con 0x7fdf6c0c7560 2024-09-17T04:34:27.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.176+0000 7fdf68ff9640 1 -- 172.21.15.43:0/1336206779 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdf5c003a20 con 0x7fdf6c0c7560 2024-09-17T04:34:27.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.208+0000 7fdf68ff9640 1 -- 172.21.15.43:0/1336206779 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fdf5c025020 con 0x7fdf6c0c7560 2024-09-17T04:34:27.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.246+0000 7f0e7a758640 1 -- 172.21.15.43:0/2749794781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e740b2f50 msgr2=0x7f0e740c20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.246+0000 7f0e7a758640 1 --2- 172.21.15.43:0/2749794781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e740b2f50 0x7f0e740c20a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0e740c9610 tx=0x7f0e6c02b560 comp rx=0 tx=0).stop 2024-09-17T04:34:27.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.248+0000 7f77f6070640 1 -- 172.21.15.43:0/597877805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f015cce0 msgr2=0x7f77f015f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.248+0000 7f0e7a758640 1 -- 172.21.15.43:0/2749794781 shutdown_connections 2024-09-17T04:34:27.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.248+0000 7f0e7a758640 1 --2- 172.21.15.43:0/2749794781 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e7416be00 0x7f0e7416c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.248+0000 7f0e7a758640 1 --2- 172.21.15.43:0/2749794781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e740b2f50 0x7f0e740c20a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.248+0000 7f0e7a758640 1 --2- 172.21.15.43:0/2749794781 >> v2:172.21.15.43:3300/0 conn(0x7f0e740c7560 0x7f0e74070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.248+0000 7f0e7a758640 1 -- 172.21.15.43:0/2749794781 >> 172.21.15.43:0/2749794781 conn(0x7f0e740c9660 msgr2=0x7f0e740c9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.248+0000 7f0e7a758640 1 -- 172.21.15.43:0/2749794781 shutdown_connections 2024-09-17T04:34:27.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.249+0000 7f0e7a758640 1 -- 172.21.15.43:0/2749794781 wait complete. 2024-09-17T04:34:27.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.251+0000 7f0e7a758640 1 Processor -- start 2024-09-17T04:34:27.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.252+0000 7f0e7a758640 1 -- start start 2024-09-17T04:34:27.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.254+0000 7f0e7a758640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e740b2f50 0x7f0e74159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.254+0000 7f0e7a758640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e740c7560 0x7f0e7408c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.254+0000 7f0e7a758640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e7416be00 0x7f0e7408cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.254+0000 7f0e7a758640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0e740c5220 con 0x7f0e740b2f50 2024-09-17T04:34:27.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.254+0000 7f0e7a758640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0e740c2db0 con 0x7f0e740c7560 2024-09-17T04:34:27.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.254+0000 7f0e7a758640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0e740c2a70 con 0x7f0e7416be00 2024-09-17T04:34:27.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.248+0000 7f77f6070640 1 --2- 172.21.15.43:0/597877805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f015cce0 0x7f77f015f780 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f77e4005fd0 tx=0x7f77e402a5f0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.255+0000 7f77f6070640 1 -- 172.21.15.43:0/597877805 shutdown_connections 2024-09-17T04:34:27.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.255+0000 7f77f6070640 1 --2- 172.21.15.43:0/597877805 >> v2:172.21.15.43:3300/0 conn(0x7f77f00735d0 0x7f77f0073b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.255+0000 7f77f6070640 1 --2- 172.21.15.43:0/597877805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f015cce0 0x7f77f015f780 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.255+0000 7f77f6070640 1 -- 172.21.15.43:0/597877805 >> 172.21.15.43:0/597877805 conn(0x7f77f00c95e0 msgr2=0x7f77f00c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.254+0000 7f0e737fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e740c7560 0x7f0e7408c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.255+0000 7f0e737fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e740c7560 0x7f0e7408c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:37256/0 (socket says 172.21.15.43:37256) 2024-09-17T04:34:27.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.255+0000 7f0e737fe640 1 -- 172.21.15.43:0/4149501715 learned_addr learned my addr 172.21.15.43:0/4149501715 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.255+0000 7f77f6070640 1 -- 172.21.15.43:0/597877805 shutdown_connections 2024-09-17T04:34:27.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.256+0000 7f644710c640 1 -- 172.21.15.43:0/1811744693 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64400c8560 msgr2=0x7f64400c6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.256+0000 7f644710c640 1 --2- 172.21.15.43:0/1811744693 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64400c8560 0x7f64400c6690 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f64400c6180 tx=0x7f643802b8b0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.257+0000 7f644710c640 1 -- 172.21.15.43:0/1811744693 shutdown_connections 2024-09-17T04:34:27.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.257+0000 7f644710c640 1 --2- 172.21.15.43:0/1811744693 >> v2:172.21.15.43:3300/0 conn(0x7f64400c4b20 0x7f644016c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.257+0000 7f644710c640 1 --2- 172.21.15.43:0/1811744693 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64400c8560 0x7f64400c6690 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.257+0000 7f644710c640 1 -- 172.21.15.43:0/1811744693 >> 172.21.15.43:0/1811744693 conn(0x7f64400cd480 msgr2=0x7f64400c9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.257+0000 7f644710c640 1 -- 172.21.15.43:0/1811744693 shutdown_connections 2024-09-17T04:34:27.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.255+0000 7f77f6070640 1 -- 172.21.15.43:0/597877805 wait complete. 2024-09-17T04:34:27.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.258+0000 7f77f6070640 1 Processor -- start 2024-09-17T04:34:27.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.257+0000 7f644710c640 1 -- 172.21.15.43:0/1811744693 wait complete. 2024-09-17T04:34:27.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.259+0000 7f77f6070640 1 -- start start 2024-09-17T04:34:27.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.260+0000 7f644710c640 1 Processor -- start 2024-09-17T04:34:27.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.261+0000 7f77f6070640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f0072670 0x7f77f01582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.261+0000 7f77f6070640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f00735d0 0x7f77f01545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.261+0000 7f77f6070640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77f015cce0 0x7f77f00c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.261+0000 7f77f6070640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f77f015c2f0 con 0x7f77f00735d0 2024-09-17T04:34:27.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.261+0000 7f77f6070640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f77f015f260 con 0x7f77f015cce0 2024-09-17T04:34:27.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.261+0000 7f77f6070640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f77f015c470 con 0x7f77f0072670 2024-09-17T04:34:27.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.255+0000 7f0e73fff640 1 --2- 172.21.15.43:0/4149501715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e740b2f50 0x7f0e74159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.261+0000 7f77eeffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f00735d0 0x7f77f01545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.262+0000 7f77effff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77f015cce0 0x7f77f00c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.262+0000 7f77eeffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f00735d0 0x7f77f01545e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34128/0 (socket says 172.21.15.43:34128) 2024-09-17T04:34:27.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.262+0000 7f77eeffd640 1 -- 172.21.15.43:0/1459937454 learned_addr learned my addr 172.21.15.43:0/1459937454 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.262+0000 7f77ef7fe640 1 --2- 172.21.15.43:0/1459937454 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f0072670 0x7f77f01582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.262+0000 7f0e73fff640 1 -- 172.21.15.43:0/4149501715 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e7416be00 msgr2=0x7f0e7408cc20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:34:27.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.262+0000 7f0e73fff640 1 --2- 172.21.15.43:0/4149501715 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e7416be00 0x7f0e7408cc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.262+0000 7f0e73fff640 1 -- 172.21.15.43:0/4149501715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e740c7560 msgr2=0x7f0e7408c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.262+0000 7f0e73fff640 1 --2- 172.21.15.43:0/4149501715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e740c7560 0x7f0e7408c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.262+0000 7f0e73fff640 1 -- 172.21.15.43:0/4149501715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e740cb770 con 0x7f0e740b2f50 2024-09-17T04:34:27.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.262+0000 7f77eeffd640 1 -- 172.21.15.43:0/1459937454 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f0072670 msgr2=0x7f77f01582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.262+0000 7f77eeffd640 1 --2- 172.21.15.43:0/1459937454 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f0072670 0x7f77f01582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.262+0000 7f77eeffd640 1 -- 172.21.15.43:0/1459937454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77f015cce0 msgr2=0x7f77f00c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.262+0000 7f77eeffd640 1 --2- 172.21.15.43:0/1459937454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77f015cce0 0x7f77f00c5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.263+0000 7f77eeffd640 1 -- 172.21.15.43:0/1459937454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f0158800 con 0x7f77f00735d0 2024-09-17T04:34:27.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.263+0000 7f77eeffd640 1 --2- 172.21.15.43:0/1459937454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f00735d0 0x7f77f01545e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f77e800c760 tx=0x7f77e800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.264+0000 7f77d7fff640 1 -- 172.21.15.43:0/1459937454 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e8003da0 con 0x7f77f00735d0 2024-09-17T04:34:27.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.264+0000 7f77d7fff640 1 -- 172.21.15.43:0/1459937454 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77e800ce10 con 0x7f77f00735d0 2024-09-17T04:34:27.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.264+0000 7f77f6070640 1 -- 172.21.15.43:0/1459937454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f01f5f60 con 0x7f77f00735d0 2024-09-17T04:34:27.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.264+0000 7f77f6070640 1 -- 172.21.15.43:0/1459937454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f01f6520 con 0x7f77f00735d0 2024-09-17T04:34:27.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.264+0000 7f77d7fff640 1 -- 172.21.15.43:0/1459937454 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e80052d0 con 0x7f77f00735d0 2024-09-17T04:34:27.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.265+0000 7f77d7fff640 1 -- 172.21.15.43:0/1459937454 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f77e80054b0 con 0x7f77f00735d0 2024-09-17T04:34:27.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.265+0000 7f77d7fff640 1 -- 172.21.15.43:0/1459937454 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f77e801b880 con 0x7f77f00735d0 2024-09-17T04:34:27.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.267+0000 7f0e73fff640 1 --2- 172.21.15.43:0/4149501715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e740b2f50 0x7f0e74159b40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400cb60 tx=0x7f0e6400b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.267+0000 7f644710c640 1 -- start start 2024-09-17T04:34:27.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.271+0000 7f0e70ff9640 1 -- 172.21.15.43:0/4149501715 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64005020 con 0x7f0e740b2f50 2024-09-17T04:34:27.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.271+0000 7f644710c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f644006d050 0x7f6440165a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.271+0000 7f644710c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64400c4b20 0x7f6440207050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.271+0000 7f0e7a758640 1 -- 172.21.15.43:0/4149501715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e7415a950 con 0x7f0e740b2f50 2024-09-17T04:34:27.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.271+0000 7f0e7a758640 1 -- 172.21.15.43:0/4149501715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e740cc2a0 con 0x7f0e740b2f50 2024-09-17T04:34:27.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.271+0000 7f0e70ff9640 1 -- 172.21.15.43:0/4149501715 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e640051c0 con 0x7f0e740b2f50 2024-09-17T04:34:27.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.273+0000 7f0e70ff9640 1 -- 172.21.15.43:0/4149501715 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64005590 con 0x7f0e740b2f50 2024-09-17T04:34:27.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.273+0000 7f0e70ff9640 1 -- 172.21.15.43:0/4149501715 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0e6400cd10 con 0x7f0e740b2f50 2024-09-17T04:34:27.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.273+0000 7f0e70ff9640 1 -- 172.21.15.43:0/4149501715 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0e64015870 con 0x7f0e740b2f50 2024-09-17T04:34:27.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.271+0000 7f644710c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f644015f2c0 0x7f644015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.271+0000 7f6445909640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64400c4b20 0x7f6440207050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.271+0000 7f6445909640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64400c4b20 0x7f6440207050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:37282/0 (socket says 172.21.15.43:37282) 2024-09-17T04:34:27.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.271+0000 7f644690b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f644015f2c0 0x7f644015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.271+0000 7f644690b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f644015f2c0 0x7f644015f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:44608/0 (socket says 172.21.15.43:44608) 2024-09-17T04:34:27.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.271+0000 7f6445909640 1 -- 172.21.15.43:0/2518306612 learned_addr learned my addr 172.21.15.43:0/2518306612 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.271+0000 7f644710c640 1 -- 172.21.15.43:0/2518306612 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6440072790 con 0x7f644006d050 2024-09-17T04:34:27.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.271+0000 7f644710c640 1 -- 172.21.15.43:0/2518306612 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f64400c6c10 con 0x7f64400c4b20 2024-09-17T04:34:27.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.271+0000 7f644710c640 1 -- 172.21.15.43:0/2518306612 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6440072910 con 0x7f644015f2c0 2024-09-17T04:34:27.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.274+0000 7f0e5a7fc640 1 -- 172.21.15.43:0/4149501715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e54005290 con 0x7f0e740b2f50 2024-09-17T04:34:27.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.274+0000 7f6445909640 1 -- 172.21.15.43:0/2518306612 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f644015f2c0 msgr2=0x7f644015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.274+0000 7f6445909640 1 --2- 172.21.15.43:0/2518306612 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f644015f2c0 0x7f644015f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.274+0000 7f6445909640 1 -- 172.21.15.43:0/2518306612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f644006d050 msgr2=0x7f6440165a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.274+0000 7f6445909640 1 --2- 172.21.15.43:0/2518306612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f644006d050 0x7f6440165a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.274+0000 7f6445909640 1 -- 172.21.15.43:0/2518306612 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644015fc10 con 0x7f64400c4b20 2024-09-17T04:34:27.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.275+0000 7f6445909640 1 --2- 172.21.15.43:0/2518306612 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64400c4b20 0x7f6440207050 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f643c00c790 tx=0x7f643c00cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.275+0000 7f6436ffd640 1 -- 172.21.15.43:0/2518306612 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c017070 con 0x7f64400c4b20 2024-09-17T04:34:27.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.275+0000 7f6436ffd640 1 -- 172.21.15.43:0/2518306612 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f643c005360 con 0x7f64400c4b20 2024-09-17T04:34:27.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.275+0000 7f644710c640 1 -- 172.21.15.43:0/2518306612 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6440207590 con 0x7f64400c4b20 2024-09-17T04:34:27.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.275+0000 7f644710c640 1 -- 172.21.15.43:0/2518306612 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644020b3f0 con 0x7f64400c4b20 2024-09-17T04:34:27.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.277+0000 7f6436ffd640 1 -- 172.21.15.43:0/2518306612 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c00a8a0 con 0x7f64400c4b20 2024-09-17T04:34:27.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.277+0000 7f6436ffd640 1 -- 172.21.15.43:0/2518306612 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f643c01a070 con 0x7f64400c4b20 2024-09-17T04:34:27.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.277+0000 7f6436ffd640 1 -- 172.21.15.43:0/2518306612 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f643c01c780 con 0x7f64400c4b20 2024-09-17T04:34:27.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.274+0000 7f24da0e5640 1 -- 172.21.15.43:0/895453924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d40735d0 msgr2=0x7f24d4155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.274+0000 7f24da0e5640 1 --2- 172.21.15.43:0/895453924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d40735d0 0x7f24d4155a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f24d4072120 tx=0x7f24cc02aa50 comp rx=0 tx=0).stop 2024-09-17T04:34:27.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.278+0000 7f24da0e5640 1 -- 172.21.15.43:0/895453924 shutdown_connections 2024-09-17T04:34:27.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.278+0000 7f24da0e5640 1 --2- 172.21.15.43:0/895453924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d40735d0 0x7f24d4155a00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.278+0000 7f24da0e5640 1 --2- 172.21.15.43:0/895453924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24d4072670 0x7f24d415c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.278+0000 7f24da0e5640 1 --2- 172.21.15.43:0/895453924 >> v2:172.21.15.62:3300/0 conn(0x7f24d415cce0 0x7f24d415f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.278+0000 7f24da0e5640 1 -- 172.21.15.43:0/895453924 >> 172.21.15.43:0/895453924 conn(0x7f24d40c95e0 msgr2=0x7f24d40c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.276+0000 7f77f6070640 1 -- 172.21.15.43:0/1459937454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d0005290 con 0x7f77f00735d0 2024-09-17T04:34:27.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.281+0000 7f0e70ff9640 1 -- 172.21.15.43:0/4149501715 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0e64015410 con 0x7f0e740b2f50 2024-09-17T04:34:27.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.282+0000 7f6434ff9640 1 -- 172.21.15.43:0/2518306612 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6428005290 con 0x7f64400c4b20 2024-09-17T04:34:27.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.287+0000 7f6436ffd640 1 -- 172.21.15.43:0/2518306612 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f644015fc10 con 0x7f64400c4b20 2024-09-17T04:34:27.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.285+0000 7f24da0e5640 1 -- 172.21.15.43:0/895453924 shutdown_connections 2024-09-17T04:34:27.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.285+0000 7f24da0e5640 1 -- 172.21.15.43:0/895453924 wait complete. 2024-09-17T04:34:27.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.288+0000 7f24da0e5640 1 Processor -- start 2024-09-17T04:34:27.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.288+0000 7f24da0e5640 1 -- start start 2024-09-17T04:34:27.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.290+0000 7f24da0e5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24d4072670 0x7f24d41597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.290+0000 7f24da0e5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24d40735d0 0x7f24d40c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.290+0000 7f24da0e5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d415cce0 0x7f24d40cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.290+0000 7f24da0e5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4155f40 con 0x7f24d415cce0 2024-09-17T04:34:27.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.290+0000 7f24da0e5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f24d406ddc0 con 0x7f24d40735d0 2024-09-17T04:34:27.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.290+0000 7f24da0e5640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f24d415a1c0 con 0x7f24d4072670 2024-09-17T04:34:27.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.291+0000 7f24d2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24d40735d0 0x7f24d40c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.291+0000 7f24d2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24d40735d0 0x7f24d40c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:37302/0 (socket says 172.21.15.43:37302) 2024-09-17T04:34:27.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.291+0000 7f24d2ffd640 1 -- 172.21.15.43:0/426863008 learned_addr learned my addr 172.21.15.43:0/426863008 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.291+0000 7f24d2ffd640 1 -- 172.21.15.43:0/426863008 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24d4072670 msgr2=0x7f24d41597b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:34:27.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.291+0000 7f24d2ffd640 1 --2- 172.21.15.43:0/426863008 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24d4072670 0x7f24d41597b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.291+0000 7f24d2ffd640 1 -- 172.21.15.43:0/426863008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d415cce0 msgr2=0x7f24d40cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.291+0000 7f24d2ffd640 1 --2- 172.21.15.43:0/426863008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d415cce0 0x7f24d40cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.291+0000 7f24d2ffd640 1 -- 172.21.15.43:0/426863008 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d4159cf0 con 0x7f24d40735d0 2024-09-17T04:34:27.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.295+0000 7f24d2ffd640 1 --2- 172.21.15.43:0/426863008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24d40735d0 0x7f24d40c8620 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f24c400e7f0 tx=0x7f24c400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.297+0000 7fd53359e640 1 -- 172.21.15.43:0/2410760827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd53415c220 msgr2=0x7fd5340c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.297+0000 7fd53359e640 1 --2- 172.21.15.43:0/2410760827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd53415c220 0x7fd5340c7390 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd53415f700 tx=0x7fd52c02aa00 comp rx=0 tx=0).stop 2024-09-17T04:34:27.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.296+0000 7f24c3fff640 1 -- 172.21.15.43:0/426863008 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c400ccc0 con 0x7f24d40735d0 2024-09-17T04:34:27.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.297+0000 7f77d7fff640 1 -- 172.21.15.43:0/1459937454 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f77e800a5e0 con 0x7f77f00735d0 2024-09-17T04:34:27.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.296+0000 7f24c3fff640 1 -- 172.21.15.43:0/426863008 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24c4010430 con 0x7f24d40735d0 2024-09-17T04:34:27.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.299+0000 7f5721113640 1 -- 172.21.15.43:0/2013201553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5704004a20 msgr2=0x7f570400b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.299+0000 7f5721113640 1 --2- 172.21.15.43:0/2013201553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5704004a20 0x7f570400b460 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f571c06b590 tx=0x7f5704003980 comp rx=0 tx=0).stop 2024-09-17T04:34:27.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.299+0000 7f5721113640 1 -- 172.21.15.43:0/2013201553 shutdown_connections 2024-09-17T04:34:27.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.299+0000 7f5721113640 1 --2- 172.21.15.43:0/2013201553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5704004a20 0x7f570400b460 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.299+0000 7f5721113640 1 -- 172.21.15.43:0/2013201553 >> 172.21.15.43:0/2013201553 conn(0x7f571c0c95e0 msgr2=0x7f571c0c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.301+0000 7fd53359e640 1 -- 172.21.15.43:0/2410760827 shutdown_connections 2024-09-17T04:34:27.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.301+0000 7fd53359e640 1 --2- 172.21.15.43:0/2410760827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd53415c220 0x7fd5340c7390 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.301+0000 7fd53359e640 1 --2- 172.21.15.43:0/2410760827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd53415fa10 0x7fd5340c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.301+0000 7fd53359e640 1 -- 172.21.15.43:0/2410760827 >> 172.21.15.43:0/2410760827 conn(0x7fd5340cd480 msgr2=0x7fd5340c9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.302+0000 7fd53359e640 1 -- 172.21.15.43:0/2410760827 shutdown_connections 2024-09-17T04:34:27.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.299+0000 7f5721113640 1 -- 172.21.15.43:0/2013201553 shutdown_connections 2024-09-17T04:34:27.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.302+0000 7fd53359e640 1 -- 172.21.15.43:0/2410760827 wait complete. 2024-09-17T04:34:27.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.305+0000 7fd53359e640 1 Processor -- start 2024-09-17T04:34:27.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.299+0000 7f5721113640 1 -- 172.21.15.43:0/2013201553 wait complete. 2024-09-17T04:34:27.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.305+0000 7fd53359e640 1 -- start start 2024-09-17T04:34:27.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.307+0000 7f5721113640 1 Processor -- start 2024-09-17T04:34:27.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.307+0000 7fd53359e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd53406cf90 0x7fd5341530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.307+0000 7fd53359e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd53415c220 0x7fd5340c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.307+0000 7f5721113640 1 -- start start 2024-09-17T04:34:27.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.296+0000 7f24c3fff640 1 -- 172.21.15.43:0/426863008 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c4010860 con 0x7f24d40735d0 2024-09-17T04:34:27.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.297+0000 7f24da0e5640 1 -- 172.21.15.43:0/426863008 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d408d5d0 con 0x7f24d40735d0 2024-09-17T04:34:27.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.297+0000 7f24da0e5640 1 -- 172.21.15.43:0/426863008 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d408dbb0 con 0x7f24d40735d0 2024-09-17T04:34:27.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.301+0000 7f24c1ffb640 1 -- 172.21.15.43:0/426863008 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d408ddf0 con 0x7f24d40735d0 2024-09-17T04:34:27.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.313+0000 7f24c3fff640 1 -- 172.21.15.43:0/426863008 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f24c4010a00 con 0x7f24d40735d0 2024-09-17T04:34:27.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.313+0000 7f24c3fff640 1 -- 172.21.15.43:0/426863008 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f24c4018cc0 con 0x7f24d40735d0 2024-09-17T04:34:27.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.313+0000 7f24c3fff640 1 -- 172.21.15.43:0/426863008 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f24d408ddf0 con 0x7f24d40735d0 2024-09-17T04:34:27.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.312+0000 7f6338ff9640 1 -- 172.21.15.43:0/1751444631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f631c005580 con 0x7f633c15cce0 2024-09-17T04:34:27.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.315+0000 7f5721113640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5704004a20 0x7f571c0bbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.315+0000 7f5721113640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571c0be670 0x7f571c1685f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.315+0000 7f571ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5704004a20 0x7f571c0bbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.315+0000 7f571ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5704004a20 0x7f571c0bbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:37324/0 (socket says 172.21.15.43:37324) 2024-09-17T04:34:27.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.316+0000 7fd53259c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd53406cf90 0x7fd5341530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.316+0000 7fd53259c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd53406cf90 0x7fd5341530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:44628/0 (socket says 172.21.15.43:44628) 2024-09-17T04:34:27.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.316+0000 7f571a59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571c0be670 0x7f571c1685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.316+0000 7f571a59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571c0be670 0x7f571c1685f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34200/0 (socket says 172.21.15.43:34200) 2024-09-17T04:34:27.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.316+0000 7f571ad9d640 1 -- 172.21.15.43:0/3407832403 learned_addr learned my addr 172.21.15.43:0/3407832403 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.316+0000 7f5721113640 1 --2- 172.21.15.43:0/3407832403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f571c20fb10 0x7f571c168b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.316+0000 7fd53259c640 1 -- 172.21.15.43:0/2429367740 learned_addr learned my addr 172.21.15.43:0/2429367740 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.316+0000 7fd53359e640 1 --2- 172.21.15.43:0/2429367740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd53415fa10 0x7fd5341547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.316+0000 7f5721113640 1 -- 172.21.15.43:0/3407832403 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f571c073300 con 0x7f571c0be670 2024-09-17T04:34:27.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.316+0000 7fd53359e640 1 -- 172.21.15.43:0/2429367740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd53415ef30 con 0x7fd53415c220 2024-09-17T04:34:27.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.316+0000 7f5721113640 1 -- 172.21.15.43:0/3407832403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f571c0c61e0 con 0x7f5704004a20 2024-09-17T04:34:27.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.316+0000 7fd53359e640 1 -- 172.21.15.43:0/2429367740 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd5340c8d40 con 0x7fd53415fa10 2024-09-17T04:34:27.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.316+0000 7fd53359e640 1 -- 172.21.15.43:0/2429367740 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd53415f210 con 0x7fd53406cf90 2024-09-17T04:34:27.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.316+0000 7f571b59e640 1 --2- 172.21.15.43:0/3407832403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f571c20fb10 0x7f571c168b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.317+0000 7f5721113640 1 -- 172.21.15.43:0/3407832403 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f571c0ca4c0 con 0x7f571c20fb10 2024-09-17T04:34:27.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.317+0000 7f571ad9d640 1 -- 172.21.15.43:0/3407832403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f571c20fb10 msgr2=0x7f571c168b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.317+0000 7f571ad9d640 1 --2- 172.21.15.43:0/3407832403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f571c20fb10 0x7f571c168b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.317+0000 7f571ad9d640 1 -- 172.21.15.43:0/3407832403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571c0be670 msgr2=0x7f571c1685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.319+0000 7fd532d9d640 1 --2- 172.21.15.43:0/2429367740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd53415fa10 0x7fd5341547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.320+0000 7fd531d9b640 1 --2- 172.21.15.43:0/2429367740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd53415c220 0x7fd5340c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.317+0000 7f571ad9d640 1 --2- 172.21.15.43:0/3407832403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571c0be670 0x7f571c1685f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.320+0000 7fd53259c640 1 -- 172.21.15.43:0/2429367740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd53415fa10 msgr2=0x7fd5341547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.317+0000 7f571ad9d640 1 -- 172.21.15.43:0/3407832403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c0bc260 con 0x7f5704004a20 2024-09-17T04:34:27.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.317+0000 7f571a59c640 1 --2- 172.21.15.43:0/3407832403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571c0be670 0x7f571c1685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:34:27.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.319+0000 7f571ad9d640 1 --2- 172.21.15.43:0/3407832403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5704004a20 0x7f571c0bbd20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f570c000fb0 tx=0x7f570c0039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.320+0000 7fd53259c640 1 --2- 172.21.15.43:0/2429367740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd53415fa10 0x7fd5341547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.320+0000 7f57037fe640 1 -- 172.21.15.43:0/3407832403 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c015070 con 0x7f5704004a20 2024-09-17T04:34:27.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.320+0000 7fd53259c640 1 -- 172.21.15.43:0/2429367740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd53415c220 msgr2=0x7fd5340c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.320+0000 7fd53259c640 1 --2- 172.21.15.43:0/2429367740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd53415c220 0x7fd5340c5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.320+0000 7fd53259c640 1 -- 172.21.15.43:0/2429367740 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd534153620 con 0x7fd53406cf90 2024-09-17T04:34:27.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.320+0000 7f57037fe640 1 -- 172.21.15.43:0/3407832403 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f570c011900 con 0x7f5704004a20 2024-09-17T04:34:27.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.320+0000 7f57037fe640 1 -- 172.21.15.43:0/3407832403 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c011d50 con 0x7f5704004a20 2024-09-17T04:34:27.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.321+0000 7f5721113640 1 -- 172.21.15.43:0/3407832403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571c0c20f0 con 0x7f5704004a20 2024-09-17T04:34:27.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.321+0000 7f5721113640 1 -- 172.21.15.43:0/3407832403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571c0c26b0 con 0x7f5704004a20 2024-09-17T04:34:27.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.321+0000 7f57037fe640 1 -- 172.21.15.43:0/3407832403 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f570c0107b0 con 0x7f5704004a20 2024-09-17T04:34:27.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.321+0000 7f57037fe640 1 -- 172.21.15.43:0/3407832403 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f570c00f3b0 con 0x7f5704004a20 2024-09-17T04:34:27.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.323+0000 7f5721113640 1 -- 172.21.15.43:0/3407832403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f571c0ca100 con 0x7f5704004a20 2024-09-17T04:34:27.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.324+0000 7fd53259c640 1 --2- 172.21.15.43:0/2429367740 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd53406cf90 0x7fd5341530e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd52400c970 tx=0x7fd52400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.326+0000 7fd522ffd640 1 -- 172.21.15.43:0/2429367740 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524004220 con 0x7fd53406cf90 2024-09-17T04:34:27.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.326+0000 7fd522ffd640 1 -- 172.21.15.43:0/2429367740 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5240079b0 con 0x7fd53406cf90 2024-09-17T04:34:27.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.326+0000 7fd522ffd640 1 -- 172.21.15.43:0/2429367740 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524007de0 con 0x7fd53406cf90 2024-09-17T04:34:27.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.326+0000 7fd53359e640 1 -- 172.21.15.43:0/2429367740 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5341552a0 con 0x7fd53406cf90 2024-09-17T04:34:27.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.327+0000 7fd53359e640 1 -- 172.21.15.43:0/2429367740 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd534157c80 con 0x7fd53406cf90 2024-09-17T04:34:27.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.328+0000 7fd522ffd640 1 -- 172.21.15.43:0/2429367740 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd5240053b0 con 0x7fd53406cf90 2024-09-17T04:34:27.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.328+0000 7fd522ffd640 1 -- 172.21.15.43:0/2429367740 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd5240037b0 con 0x7fd53406cf90 2024-09-17T04:34:27.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.328+0000 7fd520ff9640 1 -- 172.21.15.43:0/2429367740 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd53406d3a0 con 0x7fd53406cf90 2024-09-17T04:34:27.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.326+0000 7fb84ab71640 1 -- 172.21.15.43:0/4213697044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb844074180 msgr2=0x7fb844074590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.326+0000 7fb84ab71640 1 --2- 172.21.15.43:0/4213697044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb844074180 0x7fb844074590 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb8440715a0 tx=0x7fb83802b780 comp rx=0 tx=0).stop 2024-09-17T04:34:27.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.326+0000 7fb84ab71640 1 -- 172.21.15.43:0/4213697044 shutdown_connections 2024-09-17T04:34:27.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.326+0000 7fb84ab71640 1 --2- 172.21.15.43:0/4213697044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb844074180 0x7fb844074590 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb8440715a0 tx=0x7fb83802b780 comp rx=0 tx=0).stop 2024-09-17T04:34:27.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.326+0000 7fb84ab71640 1 --2- 172.21.15.43:0/4213697044 >> v2:172.21.15.62:3300/0 conn(0x7fb844072670 0x7fb84406e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.326+0000 7fb84ab71640 1 -- 172.21.15.43:0/4213697044 >> 172.21.15.43:0/4213697044 conn(0x7fb8440c95e0 msgr2=0x7fb8440c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.328+0000 7fb84ab71640 1 -- 172.21.15.43:0/4213697044 shutdown_connections 2024-09-17T04:34:27.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.330+0000 7f633affd640 1 -- 172.21.15.43:0/1751444631 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v10)=0 v10) ==== 127+0+0 (secure 0 0 0) 0x7f6330014030 con 0x7f633c15cce0 2024-09-17T04:34:27.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.333+0000 7fd522ffd640 1 -- 172.21.15.43:0/2429367740 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd524014030 con 0x7fd53406cf90 2024-09-17T04:34:27.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.333+0000 7fc15536e640 1 -- 172.21.15.43:0/3885632233 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc138005360 msgr2=0x7fc13800b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.333+0000 7fc15536e640 1 --2- 172.21.15.43:0/3885632233 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc138005360 0x7fc13800b9e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc1480043b0 tx=0x7fc138005830 comp rx=0 tx=0).stop 2024-09-17T04:34:27.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.333+0000 7fc14f7fe640 1 -- 172.21.15.43:0/3885632233 reap_dead start 2024-09-17T04:34:27.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.335+0000 7f57037fe640 1 -- 172.21.15.43:0/3407832403 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f570c019e10 con 0x7f5704004a20 2024-09-17T04:34:27.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.335+0000 7fc15536e640 1 -- 172.21.15.43:0/3885632233 shutdown_connections 2024-09-17T04:34:27.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.335+0000 7fc15536e640 1 -- 172.21.15.43:0/3885632233 >> 172.21.15.43:0/3885632233 conn(0x7fc1500c95e0 msgr2=0x7fc1500c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.332+0000 7fb84ab71640 1 -- 172.21.15.43:0/4213697044 wait complete. 2024-09-17T04:34:27.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.334+0000 7fb84ab71640 1 Processor -- start 2024-09-17T04:34:27.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.335+0000 7fb84ab71640 1 -- start start 2024-09-17T04:34:27.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.337+0000 7fb84ab71640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb844072670 0x7fb8441645c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.337+0000 7fb84ab71640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb84416c170 0x7fb8441f7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.337+0000 7fb84ab71640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb844165280 0x7fb844162b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.337+0000 7fb84ab71640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb844073300 con 0x7fb844165280 2024-09-17T04:34:27.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.337+0000 7fb84ab71640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb844072da0 con 0x7fb84416c170 2024-09-17T04:34:27.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.337+0000 7fb84ab71640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb8440ca4c0 con 0x7fb844072670 2024-09-17T04:34:27.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.337+0000 7fb84910e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb844165280 0x7fb844162b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.337+0000 7fb84910e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb844165280 0x7fb844162b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34220/0 (socket says 172.21.15.43:34220) 2024-09-17T04:34:27.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.338+0000 7fb84910e640 1 -- 172.21.15.43:0/3165807398 learned_addr learned my addr 172.21.15.43:0/3165807398 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.338+0000 7fb84910e640 1 -- 172.21.15.43:0/3165807398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb844072670 msgr2=0x7fb8441645c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T04:34:27.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.338+0000 7fb84910e640 1 --2- 172.21.15.43:0/3165807398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb844072670 0x7fb8441645c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.338+0000 7fb84910e640 1 -- 172.21.15.43:0/3165807398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb84416c170 msgr2=0x7fb8441f7ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:34:27.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.338+0000 7fb84910e640 1 --2- 172.21.15.43:0/3165807398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb84416c170 0x7fb8441f7ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.338+0000 7fb84910e640 1 -- 172.21.15.43:0/3165807398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8441f8420 con 0x7fb844165280 2024-09-17T04:34:27.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.339+0000 7f6338ff9640 1 -- 172.21.15.43:0/1751444631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f633c15cce0 msgr2=0x7f633c073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.339+0000 7f6338ff9640 1 --2- 172.21.15.43:0/1751444631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f633c15cce0 0x7f633c073a40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f633c0c95b0 tx=0x7f633000cba0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.338+0000 7fb84910e640 1 --2- 172.21.15.43:0/3165807398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb844165280 0x7fb844162b50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00caf0 tx=0x7fb83c002090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.337+0000 7fc15536e640 1 -- 172.21.15.43:0/3885632233 shutdown_connections 2024-09-17T04:34:27.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.341+0000 7fb8417fa640 1 -- 172.21.15.43:0/3165807398 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c017070 con 0x7fb844165280 2024-09-17T04:34:27.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.341+0000 7fb84ab71640 1 -- 172.21.15.43:0/3165807398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb844163090 con 0x7fb844165280 2024-09-17T04:34:27.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.341+0000 7fb84ab71640 1 -- 172.21.15.43:0/3165807398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb844164cc0 con 0x7fb844165280 2024-09-17T04:34:27.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.341+0000 7fb8417fa640 1 -- 172.21.15.43:0/3165807398 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb83c003c60 con 0x7fb844165280 2024-09-17T04:34:27.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.341+0000 7fb8417fa640 1 -- 172.21.15.43:0/3165807398 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c0052d0 con 0x7fb844165280 2024-09-17T04:34:27.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.343+0000 7f6338ff9640 1 -- 172.21.15.43:0/1751444631 shutdown_connections 2024-09-17T04:34:27.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.343+0000 7f6338ff9640 1 --2- 172.21.15.43:0/1751444631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f633c15cce0 0x7f633c073a40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.343+0000 7f6338ff9640 1 --2- 172.21.15.43:0/1751444631 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f633c0735d0 0x7f633c144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.343+0000 7f6338ff9640 1 --2- 172.21.15.43:0/1751444631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f633c072670 0x7f633c147b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.343+0000 7f6338ff9640 1 -- 172.21.15.43:0/1751444631 >> 172.21.15.43:0/1751444631 conn(0x7f633c0c95e0 msgr2=0x7f633c15a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.343+0000 7f6338ff9640 1 -- 172.21.15.43:0/1751444631 shutdown_connections 2024-09-17T04:34:27.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.343+0000 7f6338ff9640 1 -- 172.21.15.43:0/1751444631 wait complete. 2024-09-17T04:34:27.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.344+0000 7fb8417fa640 1 -- 172.21.15.43:0/3165807398 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb83c01a070 con 0x7fb844165280 2024-09-17T04:34:27.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.344+0000 7fb8417fa640 1 -- 172.21.15.43:0/3165807398 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb83c01c780 con 0x7fb844165280 2024-09-17T04:34:27.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.344+0000 7fb84ab71640 1 -- 172.21.15.43:0/3165807398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb824005290 con 0x7fb844165280 2024-09-17T04:34:27.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.342+0000 7fc15536e640 1 -- 172.21.15.43:0/3885632233 wait complete. 2024-09-17T04:34:27.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.345+0000 7fc15536e640 1 Processor -- start 2024-09-17T04:34:27.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.345+0000 7fc15536e640 1 -- start start 2024-09-17T04:34:27.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.348+0000 7fc15536e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc138005360 0x7fc1501f1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.348+0000 7fc14effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc138005360 0x7fc1501f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.348+0000 7fc14effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc138005360 0x7fc1501f1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34232/0 (socket says 172.21.15.43:34232) 2024-09-17T04:34:27.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.348+0000 7fc14effd640 1 -- 172.21.15.43:0/2749010045 learned_addr learned my addr 172.21.15.43:0/2749010045 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.348+0000 7fc15536e640 1 --2- 172.21.15.43:0/2749010045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1501537d0 0x7fc15014e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.349+0000 7fc15536e640 1 --2- 172.21.15.43:0/2749010045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc150073ab0 0x7fc150073ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.349+0000 7fc14e7fc640 1 --2- 172.21.15.43:0/2749010045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1501537d0 0x7fc15014e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.349+0000 7fc15536e640 1 -- 172.21.15.43:0/2749010045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc15015c680 con 0x7fc138005360 2024-09-17T04:34:27.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.349+0000 7fc14f7fe640 1 --2- 172.21.15.43:0/2749010045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc150073ab0 0x7fc150073ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.349+0000 7fc15536e640 1 -- 172.21.15.43:0/2749010045 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc15015c500 con 0x7fc150073ab0 2024-09-17T04:34:27.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.349+0000 7fc15536e640 1 -- 172.21.15.43:0/2749010045 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc15006dfa0 con 0x7fc1501537d0 2024-09-17T04:34:27.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.350+0000 7fc14effd640 1 -- 172.21.15.43:0/2749010045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1501537d0 msgr2=0x7fc15014e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.350+0000 7fc14effd640 1 --2- 172.21.15.43:0/2749010045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1501537d0 0x7fc15014e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.350+0000 7fc14effd640 1 -- 172.21.15.43:0/2749010045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc150073ab0 msgr2=0x7fc150073ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.350+0000 7fc14effd640 1 --2- 172.21.15.43:0/2749010045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc150073ab0 0x7fc150073ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.350+0000 7fc14effd640 1 -- 172.21.15.43:0/2749010045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1501f16b0 con 0x7fc138005360 2024-09-17T04:34:27.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.355+0000 7fc14effd640 1 --2- 172.21.15.43:0/2749010045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc138005360 0x7fc1501f1170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc140003670 tx=0x7fc140003b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.355+0000 7fc14e7fc640 1 --2- 172.21.15.43:0/2749010045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1501537d0 0x7fc15014e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:34:27.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.355+0000 7fc14f7fe640 1 --2- 172.21.15.43:0/2749010045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc150073ab0 0x7fc150073ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:34:27.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.355+0000 7fc1377fe640 1 -- 172.21.15.43:0/2749010045 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140015070 con 0x7fc138005360 2024-09-17T04:34:27.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.356+0000 7fc1377fe640 1 -- 172.21.15.43:0/2749010045 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc14000f8d0 con 0x7fc138005360 2024-09-17T04:34:27.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.356+0000 7fc15536e640 1 -- 172.21.15.43:0/2749010045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1501524b0 con 0x7fc138005360 2024-09-17T04:34:27.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.356+0000 7fc15536e640 1 -- 172.21.15.43:0/2749010045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc150152790 con 0x7fc138005360 2024-09-17T04:34:27.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.359+0000 7fc1377fe640 1 -- 172.21.15.43:0/2749010045 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14000fd00 con 0x7fc138005360 2024-09-17T04:34:27.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.360+0000 7fc1377fe640 1 -- 172.21.15.43:0/2749010045 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc1400117c0 con 0x7fc138005360 2024-09-17T04:34:27.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.361+0000 7fb8417fa640 1 -- 172.21.15.43:0/3165807398 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb83c021070 con 0x7fb844165280 2024-09-17T04:34:27.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.365+0000 7fc1377fe640 1 -- 172.21.15.43:0/2749010045 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc140010d40 con 0x7fc138005360 2024-09-17T04:34:27.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.365+0000 7fc1357fa640 1 -- 172.21.15.43:0/2749010045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc130005290 con 0x7fc138005360 2024-09-17T04:34:27.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.369+0000 7fc1377fe640 1 -- 172.21.15.43:0/2749010045 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc140011c40 con 0x7fc138005360 2024-09-17T04:34:27.383 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.391+0000 7ff60d264640 1 -- 172.21.15.43:0/114491783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff600005c50 msgr2=0x7ff600006060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.391+0000 7ff60d264640 1 --2- 172.21.15.43:0/114491783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff600005c50 0x7ff600006060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff60000dc50 tx=0x7ff5fc02a5d0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.393+0000 7ff60d264640 1 -- 172.21.15.43:0/114491783 shutdown_connections 2024-09-17T04:34:27.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.393+0000 7ff60d264640 1 --2- 172.21.15.43:0/114491783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff600005c50 0x7ff600006060 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.393+0000 7ff60d264640 1 --2- 172.21.15.43:0/114491783 >> v2:172.21.15.43:3300/0 conn(0x7ff6000df620 0x7ff6000454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.393+0000 7ff60d264640 1 -- 172.21.15.43:0/114491783 >> 172.21.15.43:0/114491783 conn(0x7ff60004fe30 msgr2=0x7ff600050240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.395+0000 7ff60d264640 1 -- 172.21.15.43:0/114491783 shutdown_connections 2024-09-17T04:34:27.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.395+0000 7f7a5e673640 1 -- 172.21.15.43:0/2185941668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a500d1690 msgr2=0x7f7a50005c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.395+0000 7f7a5e673640 1 --2- 172.21.15.43:0/2185941668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a500d1690 0x7f7a50005c40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7a500466b0 tx=0x7f7a4802b1e0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.395+0000 7f7a5e673640 1 -- 172.21.15.43:0/2185941668 shutdown_connections 2024-09-17T04:34:27.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.395+0000 7f7a5e673640 1 --2- 172.21.15.43:0/2185941668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a500d1690 0x7f7a50005c40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.395+0000 7f7a5e673640 1 --2- 172.21.15.43:0/2185941668 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a50044ca0 0x7f7a500db6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.395+0000 7f7a5e673640 1 -- 172.21.15.43:0/2185941668 >> 172.21.15.43:0/2185941668 conn(0x7f7a5004fe20 msgr2=0x7f7a50050230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.399+0000 7ff60d264640 1 -- 172.21.15.43:0/114491783 wait complete. 2024-09-17T04:34:27.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.399+0000 7f65c8e30640 1 -- 172.21.15.43:0/2050923226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f65a8005580 con 0x7f65bc04c180 2024-09-17T04:34:27.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.401+0000 7ff60d264640 1 Processor -- start 2024-09-17T04:34:27.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.402+0000 7ff60d264640 1 -- start start 2024-09-17T04:34:27.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.404+0000 7ff60d264640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff600005c50 0x7ff600047c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.404+0000 7ff60d264640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff600044d20 0x7ff6000d6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.404+0000 7ff60d264640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6000df620 0x7ff6000d66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.405+0000 7ff606ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff600005c50 0x7ff600047c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.405+0000 7ff606ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff600005c50 0x7ff600047c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:37354/0 (socket says 172.21.15.43:37354) 2024-09-17T04:34:27.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.405+0000 7ff60d264640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff6000465d0 con 0x7ff6000df620 2024-09-17T04:34:27.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.405+0000 7ff6067fc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff600044d20 0x7ff6000d6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.405+0000 7ff60d264640 1 -- 172.21.15.43:0/3826710492 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff6000065a0 con 0x7ff600005c50 2024-09-17T04:34:27.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.405+0000 7ff60d264640 1 -- 172.21.15.43:0/3826710492 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff6000468b0 con 0x7ff600044d20 2024-09-17T04:34:27.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.405+0000 7ff6077fe640 1 --2- 172.21.15.43:0/3826710492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6000df620 0x7ff6000d66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.405+0000 7ff606ffd640 1 -- 172.21.15.43:0/3826710492 learned_addr learned my addr 172.21.15.43:0/3826710492 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.405+0000 7ff606ffd640 1 -- 172.21.15.43:0/3826710492 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff600044d20 msgr2=0x7ff6000d6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.405+0000 7ff606ffd640 1 --2- 172.21.15.43:0/3826710492 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff600044d20 0x7ff6000d6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.405+0000 7ff606ffd640 1 -- 172.21.15.43:0/3826710492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6000df620 msgr2=0x7ff6000d66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.405+0000 7ff606ffd640 1 --2- 172.21.15.43:0/3826710492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6000df620 0x7ff6000d66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.406+0000 7ff606ffd640 1 -- 172.21.15.43:0/3826710492 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6000481d0 con 0x7ff600005c50 2024-09-17T04:34:27.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.406+0000 7ff606ffd640 1 --2- 172.21.15.43:0/3826710492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff600005c50 0x7ff600047c90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff60807ca30 tx=0x7ff60806a0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.406+0000 7faf033be640 1 -- 172.21.15.43:0/3066303401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faefc0728b0 msgr2=0x7faefc1577d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.406+0000 7faf033be640 1 --2- 172.21.15.43:0/3066303401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faefc0728b0 0x7faefc1577d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faeec009860 tx=0x7faeec02a3b0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.406+0000 7faf033be640 1 -- 172.21.15.43:0/3066303401 shutdown_connections 2024-09-17T04:34:27.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.406+0000 7faf033be640 1 --2- 172.21.15.43:0/3066303401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faefc0728b0 0x7faefc1577d0 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faeec009860 tx=0x7faeec02a3b0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.409+0000 7ff5ef7fe640 1 -- 172.21.15.43:0/3826710492 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff608077720 con 0x7ff600005c50 2024-09-17T04:34:27.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.409+0000 7ff5ef7fe640 1 -- 172.21.15.43:0/3826710492 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff60806b480 con 0x7ff600005c50 2024-09-17T04:34:27.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.410+0000 7ff60d264640 1 -- 172.21.15.43:0/3826710492 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff60017d720 con 0x7ff600005c50 2024-09-17T04:34:27.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.410+0000 7ff60d264640 1 -- 172.21.15.43:0/3826710492 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6000d7450 con 0x7ff600005c50 2024-09-17T04:34:27.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.410+0000 7ff5ef7fe640 1 -- 172.21.15.43:0/3826710492 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff608075400 con 0x7ff600005c50 2024-09-17T04:34:27.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.406+0000 7faf033be640 1 -- 172.21.15.43:0/3066303401 >> 172.21.15.43:0/3066303401 conn(0x7faefc0cd480 msgr2=0x7faefc0c9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.411+0000 7f65b2ffd640 1 -- 172.21.15.43:0/2050923226 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v11)=0 v11) ==== 116+0+0 (secure 0 0 0) 0x7f65c40b6ce0 con 0x7f65bc04c180 2024-09-17T04:34:27.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.411+0000 7ff5ef7fe640 1 -- 172.21.15.43:0/3826710492 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff6080967b0 con 0x7ff600005c50 2024-09-17T04:34:27.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.411+0000 7ff5ef7fe640 1 -- 172.21.15.43:0/3826710492 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff60809fb30 con 0x7ff600005c50 2024-09-17T04:34:27.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.413+0000 7ff60d264640 1 -- 172.21.15.43:0/3826710492 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e8005290 con 0x7ff600005c50 2024-09-17T04:34:27.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.401+0000 7f7a5e673640 1 -- 172.21.15.43:0/2185941668 shutdown_connections 2024-09-17T04:34:27.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.405+0000 7f7a5e673640 1 -- 172.21.15.43:0/2185941668 wait complete. 2024-09-17T04:34:27.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.413+0000 7f7a5e673640 1 Processor -- start 2024-09-17T04:34:27.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.413+0000 7faf033be640 1 -- 172.21.15.43:0/3066303401 shutdown_connections 2024-09-17T04:34:27.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.413+0000 7faf033be640 1 -- 172.21.15.43:0/3066303401 wait complete. 2024-09-17T04:34:27.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.415+0000 7f65b0ff9640 1 -- 172.21.15.43:0/2050923226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65bc04c180 msgr2=0x7f65bc10e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.415+0000 7f65b0ff9640 1 --2- 172.21.15.43:0/2050923226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65bc04c180 0x7f65bc10e000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f65c4052860 tx=0x7f65c409e610 comp rx=0 tx=0).stop 2024-09-17T04:34:27.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.415+0000 7f65b0ff9640 1 -- 172.21.15.43:0/2050923226 shutdown_connections 2024-09-17T04:34:27.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.415+0000 7f65b0ff9640 1 --2- 172.21.15.43:0/2050923226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65bc04c180 0x7f65bc10e000 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f65c4052860 tx=0x7f65c409e610 comp rx=0 tx=0).stop 2024-09-17T04:34:27.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.415+0000 7f65b0ff9640 1 --2- 172.21.15.43:0/2050923226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65bc0ffda0 0x7f65bc0db750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.415+0000 7f65b0ff9640 1 --2- 172.21.15.43:0/2050923226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65bc0071e0 0x7f65bc0f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.415+0000 7f65b0ff9640 1 -- 172.21.15.43:0/2050923226 >> 172.21.15.43:0/2050923226 conn(0x7f65bc04fe30 msgr2=0x7f65bc04a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.415+0000 7ff5ef7fe640 1 -- 172.21.15.43:0/3826710492 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff6080a4020 con 0x7ff600005c50 2024-09-17T04:34:27.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.415+0000 7f65b0ff9640 1 -- 172.21.15.43:0/2050923226 shutdown_connections 2024-09-17T04:34:27.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.415+0000 7f65b0ff9640 1 -- 172.21.15.43:0/2050923226 wait complete. 2024-09-17T04:34:27.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.413+0000 7f7a5e673640 1 -- start start 2024-09-17T04:34:27.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.415+0000 7faf033be640 1 Processor -- start 2024-09-17T04:34:27.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.415+0000 7f7a5e673640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a50044ca0 0x7f7a501636b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.415+0000 7f7a5e673640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a500469c0 0x7f7a500cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.416+0000 7faf033be640 1 -- start start 2024-09-17T04:34:27.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.416+0000 7f7a5e673640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a500d1690 0x7f7a500d36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.416+0000 7f7a5ce70640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a500469c0 0x7f7a500cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.416+0000 7f7a5ce70640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a500469c0 0x7f7a500cac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:37370/0 (socket says 172.21.15.43:37370) 2024-09-17T04:34:27.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.416+0000 7f7a5de72640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a500d1690 0x7f7a500d36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.416+0000 7f7a5de72640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a500d1690 0x7f7a500d36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34262/0 (socket says 172.21.15.43:34262) 2024-09-17T04:34:27.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.418+0000 7fc770b77640 1 -- 172.21.15.43:0/1290678909 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c0b2f50 msgr2=0x7fc76c0c20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.418+0000 7faf033be640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faefc073000 0x7faefc14dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.418+0000 7faf033be640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faefc0c4460 0x7faefc14cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.418+0000 7faf033be640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faefc1538e0 0x7faefc16a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.418+0000 7faf033be640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faefc06d640 con 0x7faefc1538e0 2024-09-17T04:34:27.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.418+0000 7faf033be640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7faefc06d4c0 con 0x7faefc073000 2024-09-17T04:34:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.418+0000 7faf033be640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7faefc0c8f70 con 0x7faefc0c4460 2024-09-17T04:34:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.418+0000 7faf02bbd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faefc1538e0 0x7faefc16a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.418+0000 7faf02bbd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faefc1538e0 0x7faefc16a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34278/0 (socket says 172.21.15.43:34278) 2024-09-17T04:34:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.418+0000 7faf02bbd640 1 -- 172.21.15.43:0/2133557666 learned_addr learned my addr 172.21.15.43:0/2133557666 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.419+0000 7faf023bc640 1 --2- 172.21.15.43:0/2133557666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faefc073000 0x7faefc14dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.419+0000 7faf01bbb640 1 --2- 172.21.15.43:0/2133557666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faefc0c4460 0x7faefc14cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.419+0000 7faf02bbd640 1 -- 172.21.15.43:0/2133557666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faefc0c4460 msgr2=0x7faefc14cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.419+0000 7faf02bbd640 1 --2- 172.21.15.43:0/2133557666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faefc0c4460 0x7faefc14cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.419+0000 7faf02bbd640 1 -- 172.21.15.43:0/2133557666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faefc073000 msgr2=0x7faefc14dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.419+0000 7faf02bbd640 1 --2- 172.21.15.43:0/2133557666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faefc073000 0x7faefc14dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.419+0000 7faf02bbd640 1 -- 172.21.15.43:0/2133557666 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faefc153070 con 0x7faefc1538e0 2024-09-17T04:34:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.419+0000 7faf02bbd640 1 --2- 172.21.15.43:0/2133557666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faefc1538e0 0x7faefc16a340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faef400c6e0 tx=0x7faef400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.418+0000 7fc770b77640 1 --2- 172.21.15.43:0/1290678909 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c0b2f50 0x7fc76c0c20a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc764005fd0 tx=0x7fc76402ba80 comp rx=0 tx=0).stop 2024-09-17T04:34:27.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.420+0000 7fc770b77640 1 -- 172.21.15.43:0/1290678909 shutdown_connections 2024-09-17T04:34:27.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.420+0000 7fc770b77640 1 --2- 172.21.15.43:0/1290678909 >> v2:172.21.15.62:3300/0 conn(0x7fc76c0c5800 0x7fc76c0c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.420+0000 7fc770b77640 1 --2- 172.21.15.43:0/1290678909 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c0b2f50 0x7fc76c0c20a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.420+0000 7fc770b77640 1 -- 172.21.15.43:0/1290678909 >> 172.21.15.43:0/1290678909 conn(0x7fc76c0c9660 msgr2=0x7fc76c0c9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.420+0000 7faef2ffd640 1 -- 172.21.15.43:0/2133557666 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef4017070 con 0x7faefc1538e0 2024-09-17T04:34:27.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.420+0000 7faef2ffd640 1 -- 172.21.15.43:0/2133557666 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faef4003c80 con 0x7faefc1538e0 2024-09-17T04:34:27.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.420+0000 7faef2ffd640 1 -- 172.21.15.43:0/2133557666 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef40052d0 con 0x7faefc1538e0 2024-09-17T04:34:27.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.420+0000 7faf033be640 1 -- 172.21.15.43:0/2133557666 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faefc153350 con 0x7faefc1538e0 2024-09-17T04:34:27.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.420+0000 7faf033be640 1 -- 172.21.15.43:0/2133557666 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faefc1571d0 con 0x7faefc1538e0 2024-09-17T04:34:27.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.421+0000 7faef2ffd640 1 -- 172.21.15.43:0/2133557666 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faef401a070 con 0x7faefc1538e0 2024-09-17T04:34:27.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.421+0000 7faef2ffd640 1 -- 172.21.15.43:0/2133557666 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faef401c780 con 0x7faefc1538e0 2024-09-17T04:34:27.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.417+0000 7f7a5d671640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a50044ca0 0x7f7a501636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.417+0000 7f7a5d671640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a50044ca0 0x7f7a501636b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:44706/0 (socket says 172.21.15.43:44706) 2024-09-17T04:34:27.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.421+0000 7f7a5ce70640 1 -- 172.21.15.43:0/3945953345 learned_addr learned my addr 172.21.15.43:0/3945953345 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.421+0000 7f7a5e673640 1 -- 172.21.15.43:0/3945953345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7a50045ee0 con 0x7f7a500d1690 2024-09-17T04:34:27.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.421+0000 7f7a5e673640 1 -- 172.21.15.43:0/3945953345 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7a50045c00 con 0x7f7a500469c0 2024-09-17T04:34:27.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.421+0000 7f7a5e673640 1 -- 172.21.15.43:0/3945953345 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7a500461c0 con 0x7f7a50044ca0 2024-09-17T04:34:27.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.422+0000 7f7a5de72640 1 -- 172.21.15.43:0/3945953345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a50044ca0 msgr2=0x7f7a501636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.422+0000 7f7a5de72640 1 --2- 172.21.15.43:0/3945953345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a50044ca0 0x7f7a501636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.422+0000 7f7a5de72640 1 -- 172.21.15.43:0/3945953345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a500469c0 msgr2=0x7f7a500cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.423+0000 7f7a5de72640 1 --2- 172.21.15.43:0/3945953345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a500469c0 0x7f7a500cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.423+0000 7f7a5de72640 1 -- 172.21.15.43:0/3945953345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a50163bf0 con 0x7f7a500d1690 2024-09-17T04:34:27.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.423+0000 7f7a5ce70640 1 --2- 172.21.15.43:0/3945953345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a500469c0 0x7f7a500cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:34:27.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.423+0000 7f7a5de72640 1 --2- 172.21.15.43:0/3945953345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a500d1690 0x7f7a500d36b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7a500340e0 tx=0x7f7a48004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.420+0000 7fc770b77640 1 -- 172.21.15.43:0/1290678909 shutdown_connections 2024-09-17T04:34:27.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.420+0000 7fc770b77640 1 -- 172.21.15.43:0/1290678909 wait complete. 2024-09-17T04:34:27.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.424+0000 7f301bfff640 1 -- 172.21.15.43:0/4062900729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f30380ca100 con 0x7f3038072670 2024-09-17T04:34:27.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.424+0000 7faf033be640 1 -- 172.21.15.43:0/2133557666 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee4005290 con 0x7faefc1538e0 2024-09-17T04:34:27.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.424+0000 7f7a4dffb640 1 -- 172.21.15.43:0/3945953345 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48004810 con 0x7f7a500d1690 2024-09-17T04:34:27.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.424+0000 7f7a5e673640 1 -- 172.21.15.43:0/3945953345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a500d1cc0 con 0x7f7a500d1690 2024-09-17T04:34:27.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.424+0000 7f7a5e673640 1 -- 172.21.15.43:0/3945953345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a50165f60 con 0x7f7a500d1690 2024-09-17T04:34:27.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.425+0000 7fc770b77640 1 Processor -- start 2024-09-17T04:34:27.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.425+0000 7f7a437fe640 1 -- 172.21.15.43:0/3945953345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a500d51f0 con 0x7f7a500d1690 2024-09-17T04:34:27.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.426+0000 7f7a4dffb640 1 -- 172.21.15.43:0/3945953345 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a480049b0 con 0x7f7a500d1690 2024-09-17T04:34:27.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.426+0000 7f7a4dffb640 1 -- 172.21.15.43:0/3945953345 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48004e20 con 0x7f7a500d1690 2024-09-17T04:34:27.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.428+0000 7faef2ffd640 1 -- 172.21.15.43:0/2133557666 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7faef4021020 con 0x7faefc1538e0 2024-09-17T04:34:27.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.436+0000 7f302e7fc640 1 -- 172.21.15.43:0/4062900729 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v12)=0 v12) ==== 116+0+0 (secure 0 0 0) 0x7f3028018070 con 0x7f3038072670 2024-09-17T04:34:27.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.437+0000 7f7a4dffb640 1 -- 172.21.15.43:0/3945953345 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7a48044020 con 0x7f7a500d1690 2024-09-17T04:34:27.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.437+0000 7f7a4dffb640 1 -- 172.21.15.43:0/3945953345 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7a48003870 con 0x7f7a500d1690 2024-09-17T04:34:27.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.437+0000 7f7a4dffb640 1 -- 172.21.15.43:0/3945953345 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7a48003ac0 con 0x7f7a500d1690 2024-09-17T04:34:27.438 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.437+0000 7f303fb6e640 1 -- 172.21.15.43:0/4062900729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3038072670 msgr2=0x7f3038167370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.437+0000 7f303fb6e640 1 --2- 172.21.15.43:0/4062900729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3038072670 0x7f3038167370 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3028041000 tx=0x7f3028011150 comp rx=0 tx=0).stop 2024-09-17T04:34:27.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.437+0000 7f303fb6e640 1 -- 172.21.15.43:0/4062900729 shutdown_connections 2024-09-17T04:34:27.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.437+0000 7f303fb6e640 1 --2- 172.21.15.43:0/4062900729 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30380c47a0 0x7f3038161f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.437+0000 7f303fb6e640 1 --2- 172.21.15.43:0/4062900729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3038072670 0x7f3038167370 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.437+0000 7f303fb6e640 1 --2- 172.21.15.43:0/4062900729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f303806ddc0 0x7f3038164200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.437+0000 7f303fb6e640 1 -- 172.21.15.43:0/4062900729 >> 172.21.15.43:0/4062900729 conn(0x7f30380c95e0 msgr2=0x7f3038074180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.438+0000 7f303fb6e640 1 -- 172.21.15.43:0/4062900729 shutdown_connections 2024-09-17T04:34:27.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.438+0000 7f303fb6e640 1 -- 172.21.15.43:0/4062900729 wait complete. 2024-09-17T04:34:27.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.438+0000 7fc770b77640 1 -- start start 2024-09-17T04:34:27.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.440+0000 7fc770b77640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76c0c5800 0x7fc76c1597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.440+0000 7fc770b77640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc76c0c7560 0x7fc76c20a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.440+0000 7fc76a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76c0c5800 0x7fc76c1597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.440+0000 7fc76a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76c0c5800 0x7fc76c1597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:37382/0 (socket says 172.21.15.43:37382) 2024-09-17T04:34:27.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.440+0000 7fc76a59c640 1 -- 172.21.15.43:0/3379324149 learned_addr learned my addr 172.21.15.43:0/3379324149 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.440+0000 7fc770b77640 1 --2- 172.21.15.43:0/3379324149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c20ad70 0x7fc76c157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.440+0000 7fc770b77640 1 -- 172.21.15.43:0/3379324149 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc76c0c5220 con 0x7fc76c0c7560 2024-09-17T04:34:27.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.441+0000 7fc76ad9d640 1 --2- 172.21.15.43:0/3379324149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c20ad70 0x7fc76c157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.441+0000 7fc770b77640 1 -- 172.21.15.43:0/3379324149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc76c0c2a70 con 0x7fc76c0c5800 2024-09-17T04:34:27.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.441+0000 7fc770b77640 1 -- 172.21.15.43:0/3379324149 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc76c070df0 con 0x7fc76c20ad70 2024-09-17T04:34:27.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.441+0000 7fc76a59c640 1 -- 172.21.15.43:0/3379324149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c20ad70 msgr2=0x7fc76c157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.441+0000 7fc76a59c640 1 --2- 172.21.15.43:0/3379324149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c20ad70 0x7fc76c157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.441+0000 7fc76a59c640 1 -- 172.21.15.43:0/3379324149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc76c0c7560 msgr2=0x7fc76c20a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.441+0000 7fc76a59c640 1 --2- 172.21.15.43:0/3379324149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc76c0c7560 0x7fc76c20a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.441+0000 7fc76a59c640 1 -- 172.21.15.43:0/3379324149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc76c0cac10 con 0x7fc76c0c5800 2024-09-17T04:34:27.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.446+0000 7fc76a59c640 1 --2- 172.21.15.43:0/3379324149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76c0c5800 0x7fc76c1597a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00c400 tx=0x7fc75c00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.447+0000 7fc75affd640 1 -- 172.21.15.43:0/3379324149 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75c011790 con 0x7fc76c0c5800 2024-09-17T04:34:27.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.447+0000 7fc75affd640 1 -- 172.21.15.43:0/3379324149 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc75c017070 con 0x7fc76c0c5800 2024-09-17T04:34:27.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.447+0000 7fc770b77640 1 -- 172.21.15.43:0/3379324149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc76c0caef0 con 0x7fc76c0c5800 2024-09-17T04:34:27.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.447+0000 7fc770b77640 1 -- 172.21.15.43:0/3379324149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc76c159280 con 0x7fc76c0c5800 2024-09-17T04:34:27.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.448+0000 7fc75affd640 1 -- 172.21.15.43:0/3379324149 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75c011ce0 con 0x7fc76c0c5800 2024-09-17T04:34:27.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.450+0000 7fc75affd640 1 -- 172.21.15.43:0/3379324149 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc75c01c460 con 0x7fc76c0c5800 2024-09-17T04:34:27.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.450+0000 7fc75affd640 1 -- 172.21.15.43:0/3379324149 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc75c012a10 con 0x7fc76c0c5800 2024-09-17T04:34:27.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.451+0000 7fc758ff9640 1 -- 172.21.15.43:0/3379324149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc750005290 con 0x7fc76c0c5800 2024-09-17T04:34:27.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.453+0000 7fc75affd640 1 -- 172.21.15.43:0/3379324149 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc75c011e80 con 0x7fc76c0c5800 2024-09-17T04:34:27.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.454+0000 7f5df12bd640 1 -- 172.21.15.43:0/1394424708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd40051c0 msgr2=0x7f5dd400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.454+0000 7f5df12bd640 1 --2- 172.21.15.43:0/1394424708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd40051c0 0x7f5dd400b9c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009b20 tx=0x7f5dd4005830 comp rx=0 tx=0).stop 2024-09-17T04:34:27.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.454+0000 7f5df12bd640 1 -- 172.21.15.43:0/1394424708 shutdown_connections 2024-09-17T04:34:27.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.454+0000 7f5df12bd640 1 --2- 172.21.15.43:0/1394424708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd40051c0 0x7f5dd400b9c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.455+0000 7f5df12bd640 1 -- 172.21.15.43:0/1394424708 >> 172.21.15.43:0/1394424708 conn(0x7f5dec0c9660 msgr2=0x7f5dec0c9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.457+0000 7f5df12bd640 1 -- 172.21.15.43:0/1394424708 shutdown_connections 2024-09-17T04:34:27.461 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.460+0000 7fb6367fc640 1 -- 172.21.15.43:0/1290586225 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c0047a0 con 0x7fb63004f880 2024-09-17T04:34:27.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.460+0000 7fb63c9fa640 1 -- 172.21.15.43:0/1290586225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb63004f880 msgr2=0x7fb63004fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.460+0000 7fb63c9fa640 1 --2- 172.21.15.43:0/1290586225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb63004f880 0x7fb63004fc90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb62c005fd0 tx=0x7fb62c02a6a0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.460+0000 7fb63c9fa640 1 -- 172.21.15.43:0/1290586225 shutdown_connections 2024-09-17T04:34:27.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.460+0000 7fb63c9fa640 1 --2- 172.21.15.43:0/1290586225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb63004f880 0x7fb63004fc90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.460+0000 7fb63c9fa640 1 --2- 172.21.15.43:0/1290586225 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb630036f80 0x7fb6300deca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.460+0000 7fb63c9fa640 1 -- 172.21.15.43:0/1290586225 >> 172.21.15.43:0/1290586225 conn(0x7fb6300541d0 msgr2=0x7fb6300545e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.459+0000 7f5df12bd640 1 -- 172.21.15.43:0/1394424708 wait complete. 2024-09-17T04:34:27.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.462+0000 7f5df12bd640 1 Processor -- start 2024-09-17T04:34:27.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.463+0000 7f5df12bd640 1 -- start start 2024-09-17T04:34:27.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.466+0000 7f5df12bd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5dec0cbb90 0x7f5dec074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.466+0000 7f5df12bd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dec0cbfa0 0x7f5dec074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.466+0000 7f5df12bd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dec15b050 0x7f5dec15b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.466+0000 7f5df12bd640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec0c2db0 con 0x7f5dec15b050 2024-09-17T04:34:27.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.466+0000 7f5df12bd640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec0c3c50 con 0x7f5dec0cbfa0 2024-09-17T04:34:27.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.466+0000 7f5df12bd640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5dec0c5220 con 0x7f5dec0cbb90 2024-09-17T04:34:27.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.466+0000 7f5deaffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5dec0cbb90 0x7f5dec074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.466+0000 7f5deaffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5dec0cbb90 0x7f5dec074880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:44746/0 (socket says 172.21.15.43:44746) 2024-09-17T04:34:27.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.466+0000 7f5deaffd640 1 -- 172.21.15.43:0/448828175 learned_addr learned my addr 172.21.15.43:0/448828175 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.466+0000 7f5dea7fc640 1 --2- 172.21.15.43:0/448828175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dec0cbfa0 0x7f5dec074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.469+0000 7fb63c9fa640 1 -- 172.21.15.43:0/1290586225 shutdown_connections 2024-09-17T04:34:27.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.470+0000 7f5deb7fe640 1 --2- 172.21.15.43:0/448828175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dec15b050 0x7f5dec15b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.470+0000 7f5deb7fe640 1 -- 172.21.15.43:0/448828175 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5dec0cbb90 msgr2=0x7f5dec074880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.470+0000 7f5deb7fe640 1 --2- 172.21.15.43:0/448828175 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5dec0cbb90 0x7f5dec074880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.470+0000 7f5deb7fe640 1 -- 172.21.15.43:0/448828175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dec0cbfa0 msgr2=0x7f5dec074dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.470+0000 7f5deb7fe640 1 --2- 172.21.15.43:0/448828175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dec0cbfa0 0x7f5dec074dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.470+0000 7f5deb7fe640 1 -- 172.21.15.43:0/448828175 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dec16a890 con 0x7f5dec15b050 2024-09-17T04:34:27.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.471+0000 7fb63c9fa640 1 -- 172.21.15.43:0/1290586225 wait complete. 2024-09-17T04:34:27.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.473+0000 7f5deb7fe640 1 --2- 172.21.15.43:0/448828175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dec15b050 0x7f5dec15b460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5dec0c4ca0 tx=0x7f5de002da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.477+0000 7f5dd37fe640 1 -- 172.21.15.43:0/448828175 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de00035f0 con 0x7f5dec15b050 2024-09-17T04:34:27.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.477+0000 7f5df12bd640 1 -- 172.21.15.43:0/448828175 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dec2034d0 con 0x7f5dec15b050 2024-09-17T04:34:27.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.477+0000 7f5df12bd640 1 -- 172.21.15.43:0/448828175 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dec1666c0 con 0x7f5dec15b050 2024-09-17T04:34:27.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.477+0000 7f5dd37fe640 1 -- 172.21.15.43:0/448828175 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5de0003790 con 0x7f5dec15b050 2024-09-17T04:34:27.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.477+0000 7f5dd37fe640 1 -- 172.21.15.43:0/448828175 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de0003be0 con 0x7f5dec15b050 2024-09-17T04:34:27.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.477+0000 7f5dd37fe640 1 -- 172.21.15.43:0/448828175 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5de0040810 con 0x7f5dec15b050 2024-09-17T04:34:27.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.477+0000 7f5dd37fe640 1 -- 172.21.15.43:0/448828175 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5de0035960 con 0x7f5dec15b050 2024-09-17T04:34:27.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.481+0000 7fb63c9fa640 1 Processor -- start 2024-09-17T04:34:27.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.484+0000 7f5df12bd640 1 -- 172.21.15.43:0/448828175 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dcc005290 con 0x7f5dec15b050 2024-09-17T04:34:27.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.480+0000 7f4bfd4d5640 1 -- 172.21.15.43:0/675652267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf80c4650 msgr2=0x7f4bf80c4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.480+0000 7f4bfd4d5640 1 --2- 172.21.15.43:0/675652267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf80c4650 0x7f4bf80c4a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4bf806a140 tx=0x7f4bf002a7a0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.480+0000 7f4bfd4d5640 1 -- 172.21.15.43:0/675652267 shutdown_connections 2024-09-17T04:34:27.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.480+0000 7f4bfd4d5640 1 --2- 172.21.15.43:0/675652267 >> v2:172.21.15.43:3300/0 conn(0x7f4bf80c8e30 0x7f4bf80c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.480+0000 7f4bfd4d5640 1 --2- 172.21.15.43:0/675652267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf80c4650 0x7f4bf80c4a60 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4bf806a140 tx=0x7f4bf002a7a0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.480+0000 7f4bfd4d5640 1 -- 172.21.15.43:0/675652267 >> 172.21.15.43:0/675652267 conn(0x7f4bf806dec0 msgr2=0x7f4bf806e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.483+0000 7fb63c9fa640 1 -- start start 2024-09-17T04:34:27.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.485+0000 7fb63c9fa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb630036f80 0x7fb6300e0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.485+0000 7fb63c9fa640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb63004f880 0x7fb6300d4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.485+0000 7fb63c9fa640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6300503f0 0x7fb630168b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.485+0000 7fb63c9fa640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb6300e2570 con 0x7fb6300503f0 2024-09-17T04:34:27.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.485+0000 7fb63c9fa640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb6300e2290 con 0x7fb630036f80 2024-09-17T04:34:27.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.485+0000 7fb63c9fa640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb6300e31a0 con 0x7fb63004f880 2024-09-17T04:34:27.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.488+0000 7fb6377fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb630036f80 0x7fb6300e0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.488+0000 7fb6377fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb630036f80 0x7fb6300e0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:37432/0 (socket says 172.21.15.43:37432) 2024-09-17T04:34:27.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.488+0000 7fb6377fe640 1 -- 172.21.15.43:0/1288023811 learned_addr learned my addr 172.21.15.43:0/1288023811 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.488+0000 7fb637fff640 1 --2- 172.21.15.43:0/1288023811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6300503f0 0x7fb630168b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.488+0000 7f4bfd4d5640 1 -- 172.21.15.43:0/675652267 shutdown_connections 2024-09-17T04:34:27.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.489+0000 7fb6377fe640 1 -- 172.21.15.43:0/1288023811 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb63004f880 msgr2=0x7fb6300d4d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:34:27.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.489+0000 7fb6377fe640 1 --2- 172.21.15.43:0/1288023811 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb63004f880 0x7fb6300d4d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.489+0000 7fb6377fe640 1 -- 172.21.15.43:0/1288023811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6300503f0 msgr2=0x7fb630168b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.489+0000 7fb6377fe640 1 --2- 172.21.15.43:0/1288023811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6300503f0 0x7fb630168b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.489+0000 7fb6377fe640 1 -- 172.21.15.43:0/1288023811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb630168710 con 0x7fb630036f80 2024-09-17T04:34:27.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.489+0000 7f5dd37fe640 1 -- 172.21.15.43:0/448828175 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5de0003d80 con 0x7f5dec15b050 2024-09-17T04:34:27.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.490+0000 7fb6377fe640 1 --2- 172.21.15.43:0/1288023811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb630036f80 0x7fb6300e0a50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb638000b60 tx=0x7fb6380755a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.494+0000 7fb623fff640 1 -- 172.21.15.43:0/1288023811 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63806b210 con 0x7fb630036f80 2024-09-17T04:34:27.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.494+0000 7fb623fff640 1 -- 172.21.15.43:0/1288023811 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb63806b3b0 con 0x7fb630036f80 2024-09-17T04:34:27.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.494+0000 7fb623fff640 1 -- 172.21.15.43:0/1288023811 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb638096650 con 0x7fb630036f80 2024-09-17T04:34:27.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.494+0000 7fb63c9fa640 1 -- 172.21.15.43:0/1288023811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb630046d10 con 0x7fb630036f80 2024-09-17T04:34:27.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.494+0000 7fb63c9fa640 1 -- 172.21.15.43:0/1288023811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb630168430 con 0x7fb630036f80 2024-09-17T04:34:27.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.496+0000 7fb63c9fa640 1 -- 172.21.15.43:0/1288023811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6300070e0 con 0x7fb630036f80 2024-09-17T04:34:27.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.495+0000 7f4bfd4d5640 1 -- 172.21.15.43:0/675652267 wait complete. 2024-09-17T04:34:27.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.497+0000 7fb623fff640 1 -- 172.21.15.43:0/1288023811 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb638096c40 con 0x7fb630036f80 2024-09-17T04:34:27.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.497+0000 7fb623fff640 1 -- 172.21.15.43:0/1288023811 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb63809f6e0 con 0x7fb630036f80 2024-09-17T04:34:27.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.498+0000 7f4bfd4d5640 1 Processor -- start 2024-09-17T04:34:27.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.501+0000 7f4bfd4d5640 1 -- start start 2024-09-17T04:34:27.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.501+0000 7fb623fff640 1 -- 172.21.15.43:0/1288023811 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb6380a5080 con 0x7fb630036f80 2024-09-17T04:34:27.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.503+0000 7f4bfd4d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf80c8e30 0x7f4bf8156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.503+0000 7f4bfd4d5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bf8152640 0x7f4bf80cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.503+0000 7f4bfd4d5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4bf80c5630 0x7f4bf80cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.503+0000 7f4bfd4d5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf8072df0 con 0x7f4bf80c5630 2024-09-17T04:34:27.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.503+0000 7f4bfd4d5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf80c9780 con 0x7f4bf80c8e30 2024-09-17T04:34:27.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.503+0000 7f4bfd4d5640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4bf80704f0 con 0x7f4bf8152640 2024-09-17T04:34:27.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.504+0000 7f4bf6ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf80c8e30 0x7f4bf8156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.504+0000 7f4bf6ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf80c8e30 0x7f4bf8156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:37434/0 (socket says 172.21.15.43:37434) 2024-09-17T04:34:27.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.504+0000 7f4bf6ffd640 1 -- 172.21.15.43:0/2978836786 learned_addr learned my addr 172.21.15.43:0/2978836786 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.506+0000 7f4bf77fe640 1 --2- 172.21.15.43:0/2978836786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4bf80c5630 0x7f4bf80cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.508+0000 7f4bf67fc640 1 --2- 172.21.15.43:0/2978836786 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bf8152640 0x7f4bf80cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.510+0000 7f4bf67fc640 1 -- 172.21.15.43:0/2978836786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf80c8e30 msgr2=0x7f4bf8156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.510+0000 7f4bf67fc640 1 --2- 172.21.15.43:0/2978836786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf80c8e30 0x7f4bf8156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.510+0000 7f4bf67fc640 1 -- 172.21.15.43:0/2978836786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4bf80c5630 msgr2=0x7f4bf80cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.510+0000 7f4bf67fc640 1 --2- 172.21.15.43:0/2978836786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4bf80c5630 0x7f4bf80cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.510+0000 7f4bf67fc640 1 -- 172.21.15.43:0/2978836786 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf8156390 con 0x7f4bf8152640 2024-09-17T04:34:27.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.510+0000 7f4bf67fc640 1 --2- 172.21.15.43:0/2978836786 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bf8152640 0x7f4bf80cce50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4bf81592d0 tx=0x7f4bf0003ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.510+0000 7f4bdf7fe640 1 -- 172.21.15.43:0/2978836786 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0041020 con 0x7f4bf8152640 2024-09-17T04:34:27.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.510+0000 7f4bfd4d5640 1 -- 172.21.15.43:0/2978836786 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf8157fb0 con 0x7f4bf8152640 2024-09-17T04:34:27.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.510+0000 7f4bfd4d5640 1 -- 172.21.15.43:0/2978836786 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf80c9bb0 con 0x7f4bf8152640 2024-09-17T04:34:27.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.512+0000 7f4bdf7fe640 1 -- 172.21.15.43:0/2978836786 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bf0037040 con 0x7f4bf8152640 2024-09-17T04:34:27.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.512+0000 7f4bdf7fe640 1 -- 172.21.15.43:0/2978836786 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0036070 con 0x7f4bf8152640 2024-09-17T04:34:27.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.512+0000 7f4bdd7fa640 1 -- 172.21.15.43:0/2978836786 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bf8152a50 con 0x7f4bf8152640 2024-09-17T04:34:27.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.515+0000 7f4bdf7fe640 1 -- 172.21.15.43:0/2978836786 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4bf0044020 con 0x7f4bf8152640 2024-09-17T04:34:27.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.515+0000 7f4bdf7fe640 1 -- 172.21.15.43:0/2978836786 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4bf0004740 con 0x7f4bf8152640 2024-09-17T04:34:27.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.517+0000 7f4bdf7fe640 1 -- 172.21.15.43:0/2978836786 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4bf004b030 con 0x7f4bf8152640 2024-09-17T04:34:27.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.576+0000 7fdf527fc640 1 -- 172.21.15.43:0/1336206779 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fdf4c005580 con 0x7fdf6c0c7560 2024-09-17T04:34:27.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.578+0000 7f0e5a7fc640 1 -- 172.21.15.43:0/4149501715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f0e54005580 con 0x7f0e740b2f50 2024-09-17T04:34:27.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.582+0000 7fdf68ff9640 1 -- 172.21.15.43:0/1336206779 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v13)=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7fdf5c0055b0 con 0x7fdf6c0c7560 2024-09-17T04:34:27.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.583+0000 7fdf527fc640 1 -- 172.21.15.43:0/1336206779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6c0c7560 msgr2=0x7fdf6c0caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.583+0000 7fdf527fc640 1 --2- 172.21.15.43:0/1336206779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6c0c7560 0x7fdf6c0caa60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c00ea00 tx=0x7fdf5c00ee00 comp rx=0 tx=0).stop 2024-09-17T04:34:27.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.583+0000 7fdf527fc640 1 -- 172.21.15.43:0/1336206779 shutdown_connections 2024-09-17T04:34:27.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.583+0000 7fdf527fc640 1 --2- 172.21.15.43:0/1336206779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf6c20a2c0 0x7fdf6c20a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.583+0000 7fdf527fc640 1 --2- 172.21.15.43:0/1336206779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf6c16be00 0x7fdf6c0c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.583+0000 7fdf527fc640 1 --2- 172.21.15.43:0/1336206779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6c0c7560 0x7fdf6c0caa60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.583+0000 7fdf527fc640 1 -- 172.21.15.43:0/1336206779 >> 172.21.15.43:0/1336206779 conn(0x7fdf6c0c9660 msgr2=0x7fdf6c169980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.584+0000 7fdf527fc640 1 -- 172.21.15.43:0/1336206779 shutdown_connections 2024-09-17T04:34:27.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.584+0000 7fdf527fc640 1 -- 172.21.15.43:0/1336206779 wait complete. 2024-09-17T04:34:27.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.587+0000 7f0e70ff9640 1 -- 172.21.15.43:0/4149501715 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v14)=0 v14) ==== 115+0+0 (secure 0 0 0) 0x7f0e64015b20 con 0x7f0e740b2f50 2024-09-17T04:34:27.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.588+0000 7f0e5a7fc640 1 -- 172.21.15.43:0/4149501715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e740b2f50 msgr2=0x7f0e74159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.589+0000 7f0e5a7fc640 1 --2- 172.21.15.43:0/4149501715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e740b2f50 0x7f0e74159b40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400cb60 tx=0x7f0e6400b7f0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.589+0000 7f0e5a7fc640 1 -- 172.21.15.43:0/4149501715 shutdown_connections 2024-09-17T04:34:27.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.589+0000 7f0e5a7fc640 1 --2- 172.21.15.43:0/4149501715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e740c7560 0x7f0e7408c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.589+0000 7f0e5a7fc640 1 --2- 172.21.15.43:0/4149501715 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e7416be00 0x7f0e7408cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.589+0000 7f0e5a7fc640 1 --2- 172.21.15.43:0/4149501715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e740b2f50 0x7f0e74159b40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.589+0000 7f0e5a7fc640 1 -- 172.21.15.43:0/4149501715 >> 172.21.15.43:0/4149501715 conn(0x7f0e740c9660 msgr2=0x7f0e740c5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.589+0000 7f0e5a7fc640 1 -- 172.21.15.43:0/4149501715 shutdown_connections 2024-09-17T04:34:27.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.589+0000 7f0e5a7fc640 1 -- 172.21.15.43:0/4149501715 wait complete. 2024-09-17T04:34:27.605 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.613 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.621+0000 7f6434ff9640 1 -- 172.21.15.43:0/2518306612 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f6428005580 con 0x7f64400c4b20 2024-09-17T04:34:27.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.625+0000 7fd520ff9640 1 -- 172.21.15.43:0/2429367740 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fd534074cd0 con 0x7fd53406cf90 2024-09-17T04:34:27.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.627+0000 7f6436ffd640 1 -- 172.21.15.43:0/2518306612 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v15)=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7f643c0035f0 con 0x7f64400c4b20 2024-09-17T04:34:27.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.630+0000 7f77f6070640 1 -- 172.21.15.43:0/1459937454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mds_dir_prefetch}] v 0) -- 0x7f77d0005580 con 0x7f77f00735d0 2024-09-17T04:34:27.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.630+0000 7fd522ffd640 1 -- 172.21.15.43:0/2429367740 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v16)=0 v16) ==== 120+0+0 (secure 0 0 0) 0x7fd524003a00 con 0x7fd53406cf90 2024-09-17T04:34:27.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.631+0000 7f6434ff9640 1 -- 172.21.15.43:0/2518306612 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64400c4b20 msgr2=0x7f6440207050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.631+0000 7f6434ff9640 1 --2- 172.21.15.43:0/2518306612 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64400c4b20 0x7f6440207050 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f643c00c790 tx=0x7f643c00cc50 comp rx=0 tx=0).stop 2024-09-17T04:34:27.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.631+0000 7f6434ff9640 1 -- 172.21.15.43:0/2518306612 shutdown_connections 2024-09-17T04:34:27.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.631+0000 7f6434ff9640 1 --2- 172.21.15.43:0/2518306612 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64400c4b20 0x7f6440207050 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.631+0000 7f6434ff9640 1 --2- 172.21.15.43:0/2518306612 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f644015f2c0 0x7f644015f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.631+0000 7f6434ff9640 1 --2- 172.21.15.43:0/2518306612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f644006d050 0x7f6440165a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.631+0000 7f6434ff9640 1 -- 172.21.15.43:0/2518306612 >> 172.21.15.43:0/2518306612 conn(0x7f64400cd480 msgr2=0x7f64400c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.631+0000 7f6434ff9640 1 -- 172.21.15.43:0/2518306612 shutdown_connections 2024-09-17T04:34:27.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.632+0000 7f6434ff9640 1 -- 172.21.15.43:0/2518306612 wait complete. 2024-09-17T04:34:27.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.631+0000 7f5721113640 1 -- 172.21.15.43:0/3407832403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f571c0c69f0 con 0x7f5704004a20 2024-09-17T04:34:27.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.634+0000 7fd520ff9640 1 -- 172.21.15.43:0/2429367740 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd53406cf90 msgr2=0x7fd5341530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.634+0000 7fd520ff9640 1 --2- 172.21.15.43:0/2429367740 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd53406cf90 0x7fd5341530e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd52400c970 tx=0x7fd52400ce30 comp rx=0 tx=0).stop 2024-09-17T04:34:27.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.634+0000 7fd520ff9640 1 -- 172.21.15.43:0/2429367740 shutdown_connections 2024-09-17T04:34:27.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.634+0000 7fd520ff9640 1 --2- 172.21.15.43:0/2429367740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd53415fa10 0x7fd5341547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.634+0000 7fd520ff9640 1 --2- 172.21.15.43:0/2429367740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd53415c220 0x7fd5340c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.634+0000 7fd520ff9640 1 --2- 172.21.15.43:0/2429367740 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd53406cf90 0x7fd5341530e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.634+0000 7fd520ff9640 1 -- 172.21.15.43:0/2429367740 >> 172.21.15.43:0/2429367740 conn(0x7fd5340cd480 msgr2=0x7fd5340c7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.634+0000 7fd520ff9640 1 -- 172.21.15.43:0/2429367740 shutdown_connections 2024-09-17T04:34:27.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.634+0000 7fd520ff9640 1 -- 172.21.15.43:0/2429367740 wait complete. 2024-09-17T04:34:27.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.635+0000 7f24c1ffb640 1 -- 172.21.15.43:0/426863008 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f24d406e320 con 0x7f24d40735d0 2024-09-17T04:34:27.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.649+0000 7f77d7fff640 1 -- 172.21.15.43:0/1459937454 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_dir_prefetch}]=0 v17)=0 v17) ==== 117+0+0 (secure 0 0 0) 0x7f77e801bad0 con 0x7f77f00735d0 2024-09-17T04:34:27.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.651+0000 7f77f6070640 1 -- 172.21.15.43:0/1459937454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f00735d0 msgr2=0x7f77f01545e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.651+0000 7f77f6070640 1 --2- 172.21.15.43:0/1459937454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f00735d0 0x7f77f01545e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f77e800c760 tx=0x7f77e800cc20 comp rx=0 tx=0).stop 2024-09-17T04:34:27.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.653+0000 7f77f6070640 1 -- 172.21.15.43:0/1459937454 shutdown_connections 2024-09-17T04:34:27.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.653+0000 7f77f6070640 1 --2- 172.21.15.43:0/1459937454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77f015cce0 0x7f77f00c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.653+0000 7f77f6070640 1 --2- 172.21.15.43:0/1459937454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f00735d0 0x7f77f01545e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.653+0000 7f77f6070640 1 --2- 172.21.15.43:0/1459937454 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f0072670 0x7f77f01582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.653+0000 7f57037fe640 1 -- 172.21.15.43:0/3407832403 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v18)=0 v18) ==== 119+0+0 (secure 0 0 0) 0x7f570c010c80 con 0x7f5704004a20 2024-09-17T04:34:27.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.653+0000 7f77f6070640 1 -- 172.21.15.43:0/1459937454 >> 172.21.15.43:0/1459937454 conn(0x7f77f00c95e0 msgr2=0x7f77f015b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.647+0000 7fb84ab71640 1 -- 172.21.15.43:0/3165807398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fb824005580 con 0x7fb844165280 2024-09-17T04:34:27.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.654+0000 7f77f6070640 1 -- 172.21.15.43:0/1459937454 shutdown_connections 2024-09-17T04:34:27.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.655+0000 7f77f6070640 1 -- 172.21.15.43:0/1459937454 wait complete. 2024-09-17T04:34:27.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.655+0000 7f5721113640 1 -- 172.21.15.43:0/3407832403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5704004a20 msgr2=0x7f571c0bbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.655+0000 7f5721113640 1 --2- 172.21.15.43:0/3407832403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5704004a20 0x7f571c0bbd20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f570c000fb0 tx=0x7f570c0039c0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.656+0000 7f5721113640 1 -- 172.21.15.43:0/3407832403 shutdown_connections 2024-09-17T04:34:27.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.656+0000 7f5721113640 1 --2- 172.21.15.43:0/3407832403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f571c20fb10 0x7f571c168b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.656+0000 7f5721113640 1 --2- 172.21.15.43:0/3407832403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571c0be670 0x7f571c1685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.656+0000 7f5721113640 1 --2- 172.21.15.43:0/3407832403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5704004a20 0x7f571c0bbd20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.656+0000 7f5721113640 1 -- 172.21.15.43:0/3407832403 >> 172.21.15.43:0/3407832403 conn(0x7f571c0c95e0 msgr2=0x7f571c0c36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.659+0000 7fc1357fa640 1 -- 172.21.15.43:0/2749010045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fc130005580 con 0x7fc138005360 2024-09-17T04:34:27.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.659+0000 7f5721113640 1 -- 172.21.15.43:0/3407832403 shutdown_connections 2024-09-17T04:34:27.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.659+0000 7f5721113640 1 -- 172.21.15.43:0/3407832403 wait complete. 2024-09-17T04:34:27.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.661+0000 7f24c3fff640 1 -- 172.21.15.43:0/426863008 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f24c4010cf0 con 0x7f24d40735d0 2024-09-17T04:34:27.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.663+0000 7f24da0e5640 1 -- 172.21.15.43:0/426863008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24d40735d0 msgr2=0x7f24d40c8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.663+0000 7f24da0e5640 1 --2- 172.21.15.43:0/426863008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24d40735d0 0x7f24d40c8620 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f24c400e7f0 tx=0x7f24c400ecb0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.663+0000 7f24da0e5640 1 -- 172.21.15.43:0/426863008 shutdown_connections 2024-09-17T04:34:27.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.663+0000 7f24da0e5640 1 --2- 172.21.15.43:0/426863008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24d40735d0 0x7f24d40c8620 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.663+0000 7f24da0e5640 1 --2- 172.21.15.43:0/426863008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d415cce0 0x7f24d40cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.663+0000 7f24da0e5640 1 --2- 172.21.15.43:0/426863008 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24d4072670 0x7f24d41597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.663+0000 7f24da0e5640 1 -- 172.21.15.43:0/426863008 >> 172.21.15.43:0/426863008 conn(0x7f24d40c95e0 msgr2=0x7f24d41517c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.663+0000 7f24da0e5640 1 -- 172.21.15.43:0/426863008 shutdown_connections 2024-09-17T04:34:27.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.663+0000 7f24da0e5640 1 -- 172.21.15.43:0/426863008 wait complete. 2024-09-17T04:34:27.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.671+0000 7ff60d264640 1 -- 172.21.15.43:0/3826710492 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7ff5e8005580 con 0x7ff600005c50 2024-09-17T04:34:27.672 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.676+0000 7fb8417fa640 1 -- 172.21.15.43:0/3165807398 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7fb83c005470 con 0x7fb844165280 2024-09-17T04:34:27.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.677+0000 7fb84ab71640 1 -- 172.21.15.43:0/3165807398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb844165280 msgr2=0x7fb844162b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.677+0000 7fb84ab71640 1 --2- 172.21.15.43:0/3165807398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb844165280 0x7fb844162b50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00caf0 tx=0x7fb83c002090 comp rx=0 tx=0).stop 2024-09-17T04:34:27.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.680+0000 7fb84ab71640 1 -- 172.21.15.43:0/3165807398 shutdown_connections 2024-09-17T04:34:27.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.680+0000 7fb84ab71640 1 --2- 172.21.15.43:0/3165807398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb84416c170 0x7fb8441f7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.680+0000 7fb84ab71640 1 --2- 172.21.15.43:0/3165807398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb844165280 0x7fb844162b50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.680+0000 7fb84ab71640 1 --2- 172.21.15.43:0/3165807398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb844072670 0x7fb8441645c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.680+0000 7fb84ab71640 1 -- 172.21.15.43:0/3165807398 >> 172.21.15.43:0/3165807398 conn(0x7fb8440c95e0 msgr2=0x7fb84408d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.681+0000 7fb84ab71640 1 -- 172.21.15.43:0/3165807398 shutdown_connections 2024-09-17T04:34:27.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.682+0000 7fb84ab71640 1 -- 172.21.15.43:0/3165807398 wait complete. 2024-09-17T04:34:27.684 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.694+0000 7fc1377fe640 1 -- 172.21.15.43:0/2749010045 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v21)=0 v21) ==== 120+0+0 (secure 0 0 0) 0x7fc140011e20 con 0x7fc138005360 2024-09-17T04:34:27.694 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_dir_prefetch', 'True'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.694 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.696+0000 7fc1357fa640 1 -- 172.21.15.43:0/2749010045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc138005360 msgr2=0x7fc1501f1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.696+0000 7fc1357fa640 1 --2- 172.21.15.43:0/2749010045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc138005360 0x7fc1501f1170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc140003670 tx=0x7fc140003b30 comp rx=0 tx=0).stop 2024-09-17T04:34:27.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.696+0000 7fc1357fa640 1 -- 172.21.15.43:0/2749010045 shutdown_connections 2024-09-17T04:34:27.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.696+0000 7fc1357fa640 1 --2- 172.21.15.43:0/2749010045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc150073ab0 0x7fc150073ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.696+0000 7fc1357fa640 1 --2- 172.21.15.43:0/2749010045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1501537d0 0x7fc15014e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.696+0000 7fc1357fa640 1 --2- 172.21.15.43:0/2749010045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc138005360 0x7fc1501f1170 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.696+0000 7fc1357fa640 1 -- 172.21.15.43:0/2749010045 >> 172.21.15.43:0/2749010045 conn(0x7fc1500c95e0 msgr2=0x7fc1501594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.697+0000 7fc1357fa640 1 -- 172.21.15.43:0/2749010045 shutdown_connections 2024-09-17T04:34:27.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.697+0000 7fc1357fa640 1 -- 172.21.15.43:0/2749010045 wait complete. 2024-09-17T04:34:27.698 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.698 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.702+0000 7fc758ff9640 1 -- 172.21.15.43:0/3379324149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fc750005580 con 0x7fc76c0c5800 2024-09-17T04:34:27.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.705+0000 7ff5ef7fe640 1 -- 172.21.15.43:0/3826710492 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v22)=0 v22) ==== 119+0+0 (secure 0 0 0) 0x7ff60809fd80 con 0x7ff600005c50 2024-09-17T04:34:27.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.707+0000 7ff5ed7fa640 1 -- 172.21.15.43:0/3826710492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff600005c50 msgr2=0x7ff600047c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.707+0000 7ff5ed7fa640 1 --2- 172.21.15.43:0/3826710492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff600005c50 0x7ff600047c90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff60807ca30 tx=0x7ff60806a0e0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.707+0000 7ff5ed7fa640 1 -- 172.21.15.43:0/3826710492 shutdown_connections 2024-09-17T04:34:27.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.707+0000 7ff5ed7fa640 1 --2- 172.21.15.43:0/3826710492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6000df620 0x7ff6000d66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.707+0000 7ff5ed7fa640 1 --2- 172.21.15.43:0/3826710492 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff600044d20 0x7ff6000d6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.707+0000 7ff5ed7fa640 1 --2- 172.21.15.43:0/3826710492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff600005c50 0x7ff600047c90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.707+0000 7ff5ed7fa640 1 -- 172.21.15.43:0/3826710492 >> 172.21.15.43:0/3826710492 conn(0x7ff60004fe30 msgr2=0x7ff60004b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.707+0000 7ff5ed7fa640 1 -- 172.21.15.43:0/3826710492 shutdown_connections 2024-09-17T04:34:27.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.707+0000 7ff5ed7fa640 1 -- 172.21.15.43:0/3826710492 wait complete. 2024-09-17T04:34:27.712 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.713+0000 7fc75affd640 1 -- 172.21.15.43:0/3379324149 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v23)=0 v23) ==== 106+0+0 (secure 0 0 0) 0x7fc75c012420 con 0x7fc76c0c5800 2024-09-17T04:34:27.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.715+0000 7fc758ff9640 1 -- 172.21.15.43:0/3379324149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76c0c5800 msgr2=0x7fc76c1597a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.715+0000 7fc758ff9640 1 --2- 172.21.15.43:0/3379324149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76c0c5800 0x7fc76c1597a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00c400 tx=0x7fc75c00c8c0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.715+0000 7f7a437fe640 1 -- 172.21.15.43:0/3945953345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f7a500d1f60 con 0x7f7a500d1690 2024-09-17T04:34:27.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.715+0000 7fc758ff9640 1 -- 172.21.15.43:0/3379324149 shutdown_connections 2024-09-17T04:34:27.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.715+0000 7fc758ff9640 1 --2- 172.21.15.43:0/3379324149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c20ad70 0x7fc76c157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.715+0000 7fc758ff9640 1 --2- 172.21.15.43:0/3379324149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc76c0c7560 0x7fc76c20a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.715+0000 7fc758ff9640 1 --2- 172.21.15.43:0/3379324149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76c0c5800 0x7fc76c1597a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.715+0000 7fc758ff9640 1 -- 172.21.15.43:0/3379324149 >> 172.21.15.43:0/3379324149 conn(0x7fc76c0c9660 msgr2=0x7fc76c166bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.715+0000 7fc758ff9640 1 -- 172.21.15.43:0/3379324149 shutdown_connections 2024-09-17T04:34:27.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.715+0000 7fc758ff9640 1 -- 172.21.15.43:0/3379324149 wait complete. 2024-09-17T04:34:27.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.718+0000 7f7a4dffb640 1 -- 172.21.15.43:0/3945953345 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v24)=0 v24) ==== 125+0+0 (secure 0 0 0) 0x7f7a48003ca0 con 0x7f7a500d1690 2024-09-17T04:34:27.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.721+0000 7f7a437fe640 1 -- 172.21.15.43:0/3945953345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a500d1690 msgr2=0x7f7a500d36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.721+0000 7f7a437fe640 1 --2- 172.21.15.43:0/3945953345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a500d1690 0x7f7a500d36b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7a500340e0 tx=0x7f7a48004260 comp rx=0 tx=0).stop 2024-09-17T04:34:27.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.721+0000 7f7a437fe640 1 -- 172.21.15.43:0/3945953345 shutdown_connections 2024-09-17T04:34:27.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.721+0000 7f7a437fe640 1 --2- 172.21.15.43:0/3945953345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a500469c0 0x7f7a500cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.721+0000 7f7a437fe640 1 --2- 172.21.15.43:0/3945953345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a500d1690 0x7f7a500d36b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.721+0000 7f7a437fe640 1 --2- 172.21.15.43:0/3945953345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a50044ca0 0x7f7a501636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.721+0000 7f7a437fe640 1 -- 172.21.15.43:0/3945953345 >> 172.21.15.43:0/3945953345 conn(0x7f7a5004fe20 msgr2=0x7f7a50034400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.721+0000 7f7a437fe640 1 -- 172.21.15.43:0/3945953345 shutdown_connections 2024-09-17T04:34:27.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.721+0000 7f7a437fe640 1 -- 172.21.15.43:0/3945953345 wait complete. 2024-09-17T04:34:27.724 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.727+0000 7f5df12bd640 1 -- 172.21.15.43:0/448828175 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f5dcc005580 con 0x7f5dec15b050 2024-09-17T04:34:27.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.730+0000 7f5dd37fe640 1 -- 172.21.15.43:0/448828175 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f5de0035bb0 con 0x7f5dec15b050 2024-09-17T04:34:27.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.731+0000 7f5df12bd640 1 -- 172.21.15.43:0/448828175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dec15b050 msgr2=0x7f5dec15b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.731+0000 7f5df12bd640 1 --2- 172.21.15.43:0/448828175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dec15b050 0x7f5dec15b460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5dec0c4ca0 tx=0x7f5de002da40 comp rx=0 tx=0).stop 2024-09-17T04:34:27.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.732+0000 7f5df12bd640 1 -- 172.21.15.43:0/448828175 shutdown_connections 2024-09-17T04:34:27.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.732+0000 7f5df12bd640 1 --2- 172.21.15.43:0/448828175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dec0cbfa0 0x7f5dec074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.732+0000 7f5df12bd640 1 --2- 172.21.15.43:0/448828175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dec15b050 0x7f5dec15b460 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.732+0000 7f5df12bd640 1 --2- 172.21.15.43:0/448828175 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5dec0cbb90 0x7f5dec074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.732+0000 7f5df12bd640 1 -- 172.21.15.43:0/448828175 >> 172.21.15.43:0/448828175 conn(0x7f5dec0c9660 msgr2=0x7f5dec168a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.733+0000 7f5df12bd640 1 -- 172.21.15.43:0/448828175 shutdown_connections 2024-09-17T04:34:27.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.733+0000 7f5df12bd640 1 -- 172.21.15.43:0/448828175 wait complete. 2024-09-17T04:34:27.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.734+0000 7faf033be640 1 -- 172.21.15.43:0/2133557666 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7faee4005580 con 0x7faefc1538e0 2024-09-17T04:34:27.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.737+0000 7faef2ffd640 1 -- 172.21.15.43:0/2133557666 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v26)=0 v26) ==== 108+0+0 (secure 0 0 0) 0x7faef4005470 con 0x7faefc1538e0 2024-09-17T04:34:27.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.738+0000 7faf033be640 1 -- 172.21.15.43:0/2133557666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faefc1538e0 msgr2=0x7faefc16a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.738+0000 7faf033be640 1 --2- 172.21.15.43:0/2133557666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faefc1538e0 0x7faefc16a340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faef400c6e0 tx=0x7faef400cba0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.738+0000 7faf033be640 1 -- 172.21.15.43:0/2133557666 shutdown_connections 2024-09-17T04:34:27.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.738+0000 7faf033be640 1 --2- 172.21.15.43:0/2133557666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faefc1538e0 0x7faefc16a340 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.738+0000 7faf033be640 1 --2- 172.21.15.43:0/2133557666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faefc0c4460 0x7faefc14cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.738+0000 7faf033be640 1 --2- 172.21.15.43:0/2133557666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faefc073000 0x7faefc14dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.738+0000 7faf033be640 1 -- 172.21.15.43:0/2133557666 >> 172.21.15.43:0/2133557666 conn(0x7faefc0cd480 msgr2=0x7faefc0cac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.738+0000 7faf033be640 1 -- 172.21.15.43:0/2133557666 shutdown_connections 2024-09-17T04:34:27.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.738+0000 7faf033be640 1 -- 172.21.15.43:0/2133557666 wait complete. 2024-09-17T04:34:27.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.751+0000 7f4bdd7fa640 1 -- 172.21.15.43:0/2978836786 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f4bf814e900 con 0x7f4bf8152640 2024-09-17T04:34:27.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.755+0000 7f4bdf7fe640 1 -- 172.21.15.43:0/2978836786 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7f4bf003d810 con 0x7f4bf8152640 2024-09-17T04:34:27.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.756+0000 7f4bdd7fa640 1 -- 172.21.15.43:0/2978836786 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bf8152640 msgr2=0x7f4bf80cce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.756+0000 7f4bdd7fa640 1 --2- 172.21.15.43:0/2978836786 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bf8152640 0x7f4bf80cce50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4bf81592d0 tx=0x7f4bf0003ce0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.756+0000 7f4bdd7fa640 1 -- 172.21.15.43:0/2978836786 shutdown_connections 2024-09-17T04:34:27.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.756+0000 7f4bdd7fa640 1 --2- 172.21.15.43:0/2978836786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4bf80c5630 0x7f4bf80cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.756+0000 7f4bdd7fa640 1 --2- 172.21.15.43:0/2978836786 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bf8152640 0x7f4bf80cce50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.756+0000 7f4bdd7fa640 1 --2- 172.21.15.43:0/2978836786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf80c8e30 0x7f4bf8156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.756+0000 7f4bdd7fa640 1 -- 172.21.15.43:0/2978836786 >> 172.21.15.43:0/2978836786 conn(0x7f4bf806dec0 msgr2=0x7f4bf8140980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.756+0000 7f4bdd7fa640 1 -- 172.21.15.43:0/2978836786 shutdown_connections 2024-09-17T04:34:27.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.756+0000 7f4bdd7fa640 1 -- 172.21.15.43:0/2978836786 wait complete. 2024-09-17T04:34:27.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.765+0000 7fb63c9fa640 1 -- 172.21.15.43:0/1288023811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fb6301688e0 con 0x7fb630036f80 2024-09-17T04:34:27.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.769+0000 7fb623fff640 1 -- 172.21.15.43:0/1288023811 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v28)=0 v28) ==== 111+0+0 (secure 0 0 0) 0x7fb6380a0c60 con 0x7fb630036f80 2024-09-17T04:34:27.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.771+0000 7fb63c9fa640 1 -- 172.21.15.43:0/1288023811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb630036f80 msgr2=0x7fb6300e0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.771+0000 7fb63c9fa640 1 --2- 172.21.15.43:0/1288023811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb630036f80 0x7fb6300e0a50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb638000b60 tx=0x7fb6380755a0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.771+0000 7fb63c9fa640 1 -- 172.21.15.43:0/1288023811 shutdown_connections 2024-09-17T04:34:27.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.771+0000 7fb63c9fa640 1 --2- 172.21.15.43:0/1288023811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6300503f0 0x7fb630168b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.771+0000 7fb63c9fa640 1 --2- 172.21.15.43:0/1288023811 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb63004f880 0x7fb6300d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.771+0000 7fb63c9fa640 1 --2- 172.21.15.43:0/1288023811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb630036f80 0x7fb6300e0a50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.771+0000 7fb63c9fa640 1 -- 172.21.15.43:0/1288023811 >> 172.21.15.43:0/1288023811 conn(0x7fb6300541d0 msgr2=0x7fb630004e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.771+0000 7fb63c9fa640 1 -- 172.21.15.43:0/1288023811 shutdown_connections 2024-09-17T04:34:27.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.771+0000 7fb63c9fa640 1 -- 172.21.15.43:0/1288023811 wait complete. 2024-09-17T04:34:27.785 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.785 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.786 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.786 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.786 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi043') 2024-09-17T04:34:27.786 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config dump 2024-09-17T04:34:27.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.939+0000 7f6506630640 1 -- 172.21.15.43:0/2276234808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65000cb490 msgr2=0x7f65000c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.939+0000 7f6506630640 1 --2- 172.21.15.43:0/2276234808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65000cb490 0x7f65000c5d90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f64f0005fd0 tx=0x7f64f002a710 comp rx=0 tx=0).stop 2024-09-17T04:34:27.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.939+0000 7f6506630640 1 -- 172.21.15.43:0/2276234808 shutdown_connections 2024-09-17T04:34:27.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.939+0000 7f6506630640 1 --2- 172.21.15.43:0/2276234808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65000cb490 0x7f65000c5d90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.939+0000 7f6506630640 1 -- 172.21.15.43:0/2276234808 >> 172.21.15.43:0/2276234808 conn(0x7f65000cefa0 msgr2=0x7f65000cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:27.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.939+0000 7f6506630640 1 -- 172.21.15.43:0/2276234808 shutdown_connections 2024-09-17T04:34:27.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.939+0000 7f6506630640 1 -- 172.21.15.43:0/2276234808 wait complete. 2024-09-17T04:34:27.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.941+0000 7f6506630640 1 Processor -- start 2024-09-17T04:34:27.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.941+0000 7f6506630640 1 -- start start 2024-09-17T04:34:27.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f6506630640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65000ca590 0x7f6500142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f6506630640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65000cb490 0x7f65000c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f6506630640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65001538e0 0x7f6500152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:27.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f6506630640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6500153cf0 con 0x7f65000ca590 2024-09-17T04:34:27.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f6506630640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6500071e00 con 0x7f65001538e0 2024-09-17T04:34:27.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f6506630640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f65000719e0 con 0x7f65000cb490 2024-09-17T04:34:27.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f64fffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65000ca590 0x7f6500142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f64fffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65000ca590 0x7f6500142db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34380/0 (socket says 172.21.15.43:34380) 2024-09-17T04:34:27.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f64fffff640 1 -- 172.21.15.43:0/1934535097 learned_addr learned my addr 172.21.15.43:0/1934535097 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:27.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f64ff7fe640 1 --2- 172.21.15.43:0/1934535097 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65000cb490 0x7f65000c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f6504bcd640 1 --2- 172.21.15.43:0/1934535097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65001538e0 0x7f6500152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:27.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f64fffff640 1 -- 172.21.15.43:0/1934535097 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65000cb490 msgr2=0x7f65000c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f64fffff640 1 --2- 172.21.15.43:0/1934535097 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65000cb490 0x7f65000c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f64fffff640 1 -- 172.21.15.43:0/1934535097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65001538e0 msgr2=0x7f6500152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:27.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f64fffff640 1 --2- 172.21.15.43:0/1934535097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65001538e0 0x7f6500152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:27.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f64fffff640 1 -- 172.21.15.43:0/1934535097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65000c7a40 con 0x7f65000ca590 2024-09-17T04:34:27.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f64fffff640 1 --2- 172.21.15.43:0/1934535097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65000ca590 0x7f6500142db0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f64f0034040 tx=0x7f64f00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:27.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f64fcff9640 1 -- 172.21.15.43:0/1934535097 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f003e030 con 0x7f65000ca590 2024-09-17T04:34:27.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f64fcff9640 1 -- 172.21.15.43:0/1934535097 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64f00047a0 con 0x7f65000ca590 2024-09-17T04:34:27.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f6506630640 1 -- 172.21.15.43:0/1934535097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65000c6440 con 0x7f65000ca590 2024-09-17T04:34:27.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.943+0000 7f64fcff9640 1 -- 172.21.15.43:0/1934535097 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f0035040 con 0x7f65000ca590 2024-09-17T04:34:27.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.944+0000 7f6506630640 1 -- 172.21.15.43:0/1934535097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65000c6d00 con 0x7f65000ca590 2024-09-17T04:34:27.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.944+0000 7f64fcff9640 1 -- 172.21.15.43:0/1934535097 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f64f0041030 con 0x7f65000ca590 2024-09-17T04:34:27.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.944+0000 7f64fcff9640 1 -- 172.21.15.43:0/1934535097 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f64f0043d70 con 0x7f65000ca590 2024-09-17T04:34:27.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.945+0000 7f6506630640 1 -- 172.21.15.43:0/1934535097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65000c5d90 con 0x7f65000ca590 2024-09-17T04:34:27.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:27.949+0000 7f64fcff9640 1 -- 172.21.15.43:0/1934535097 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f64f0043410 con 0x7f65000ca590 2024-09-17T04:34:28.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.010+0000 7f6506630640 1 -- 172.21.15.43:0/1934535097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f6500146e10 con 0x7f65000ca590 2024-09-17T04:34:28.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.011+0000 7f64fcff9640 1 -- 172.21.15.43:0/1934535097 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v28) ==== 59+0+1848 (secure 0 0 0) 0x7f64f004d480 con 0x7f65000ca590 2024-09-17T04:34:28.011 INFO:teuthology.orchestra.run.smithi043.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T04:34:28.011 INFO:teuthology.orchestra.run.smithi043.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T04:34:28.011 INFO:teuthology.orchestra.run.smithi043.stdout:mgr advanced client_mount_timeout 30 2024-09-17T04:34:28.011 INFO:teuthology.orchestra.run.smithi043.stdout:mgr advanced debug_client 20/20 2024-09-17T04:34:28.011 INFO:teuthology.orchestra.run.smithi043.stdout:mgr advanced debug_mgr 20/20 2024-09-17T04:34:28.011 INFO:teuthology.orchestra.run.smithi043.stdout:mgr advanced debug_ms 1/1 2024-09-17T04:34:28.011 INFO:teuthology.orchestra.run.smithi043.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T04:34:28.011 INFO:teuthology.orchestra.run.smithi043.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T04:34:28.012 INFO:teuthology.orchestra.run.smithi043.stdout:mds advanced debug_mds 20/20 2024-09-17T04:34:28.012 INFO:teuthology.orchestra.run.smithi043.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T04:34:28.012 INFO:teuthology.orchestra.run.smithi043.stdout:mds advanced debug_ms 2/2 2024-09-17T04:34:28.012 INFO:teuthology.orchestra.run.smithi043.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-17T04:34:28.012 INFO:teuthology.orchestra.run.smithi043.stdout:mds advanced mds_bal_merge_size 5 2024-09-17T04:34:28.012 INFO:teuthology.orchestra.run.smithi043.stdout:mds advanced mds_bal_split_bits 3 2024-09-17T04:34:28.012 INFO:teuthology.orchestra.run.smithi043.stdout:mds advanced mds_bal_split_size 100 2024-09-17T04:34:28.012 INFO:teuthology.orchestra.run.smithi043.stdout:mds dev mds_debug_frag true 2024-09-17T04:34:28.012 INFO:teuthology.orchestra.run.smithi043.stdout:mds dev mds_debug_scatterstat true 2024-09-17T04:34:28.012 INFO:teuthology.orchestra.run.smithi043.stdout:mds advanced mds_dir_prefetch true 2024-09-17T04:34:28.012 INFO:teuthology.orchestra.run.smithi043.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T04:34:28.012 INFO:teuthology.orchestra.run.smithi043.stdout:mds dev mds_verify_scatter true 2024-09-17T04:34:28.012 INFO:teuthology.orchestra.run.smithi043.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T04:34:28.012 INFO:teuthology.orchestra.run.smithi043.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T04:34:28.013 INFO:teuthology.orchestra.run.smithi043.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T04:34:28.013 INFO:teuthology.orchestra.run.smithi043.stdout:client advanced client_mount_timeout 600 2024-09-17T04:34:28.013 INFO:teuthology.orchestra.run.smithi043.stdout:client advanced debug_client 20/20 2024-09-17T04:34:28.013 INFO:teuthology.orchestra.run.smithi043.stdout:client advanced debug_ms 1/1 2024-09-17T04:34:28.013 INFO:teuthology.orchestra.run.smithi043.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T04:34:28.013 INFO:teuthology.orchestra.run.smithi043.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T04:34:28.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.012+0000 7f6506630640 1 -- 172.21.15.43:0/1934535097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65000ca590 msgr2=0x7f6500142db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:28.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.012+0000 7f6506630640 1 --2- 172.21.15.43:0/1934535097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65000ca590 0x7f6500142db0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f64f0034040 tx=0x7f64f00039e0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.012+0000 7f6506630640 1 -- 172.21.15.43:0/1934535097 shutdown_connections 2024-09-17T04:34:28.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.012+0000 7f6506630640 1 --2- 172.21.15.43:0/1934535097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65001538e0 0x7f6500152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.012+0000 7f6506630640 1 --2- 172.21.15.43:0/1934535097 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65000cb490 0x7f65000c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.012+0000 7f6506630640 1 --2- 172.21.15.43:0/1934535097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65000ca590 0x7f6500142db0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.012+0000 7f6506630640 1 -- 172.21.15.43:0/1934535097 >> 172.21.15.43:0/1934535097 conn(0x7f65000cefa0 msgr2=0x7f65000cbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:28.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.012+0000 7f6506630640 1 -- 172.21.15.43:0/1934535097 shutdown_connections 2024-09-17T04:34:28.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.012+0000 7f6506630640 1 -- 172.21.15.43:0/1934535097 wait complete. 2024-09-17T04:34:28.023 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T04:34:28.023 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T04:34:28.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.138+0000 7fc34f739640 1 -- 172.21.15.43:0/1988237762 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc348074880 msgr2=0x7fc348155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:28.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.138+0000 7fc34f739640 1 --2- 172.21.15.43:0/1988237762 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc348074880 0x7fc348155c40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc3480750f0 tx=0x7fc33c02a580 comp rx=0 tx=0).stop 2024-09-17T04:34:28.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.138+0000 7fc34f739640 1 -- 172.21.15.43:0/1988237762 shutdown_connections 2024-09-17T04:34:28.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.138+0000 7fc34f739640 1 --2- 172.21.15.43:0/1988237762 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc348074880 0x7fc348155c40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.138+0000 7fc34f739640 1 -- 172.21.15.43:0/1988237762 >> 172.21.15.43:0/1988237762 conn(0x7fc348071a00 msgr2=0x7fc3480cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:28.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.138+0000 7fc34f739640 1 -- 172.21.15.43:0/1988237762 shutdown_connections 2024-09-17T04:34:28.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.138+0000 7fc34f739640 1 -- 172.21.15.43:0/1988237762 wait complete. 2024-09-17T04:34:28.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.140+0000 7fc34f739640 1 Processor -- start 2024-09-17T04:34:28.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.140+0000 7fc34f739640 1 -- start start 2024-09-17T04:34:28.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.141+0000 7fc34f739640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc34806dec0 0x7fc348152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:28.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.141+0000 7fc34f739640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3480736d0 0x7fc3481f1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:28.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.141+0000 7fc34f739640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc348074880 0x7fc3480cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:28.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.141+0000 7fc34f739640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc3480ce380 con 0x7fc3480736d0 2024-09-17T04:34:28.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.141+0000 7fc34f739640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc348158bf0 con 0x7fc348074880 2024-09-17T04:34:28.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.141+0000 7fc34f739640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc3480b3f30 con 0x7fc34806dec0 2024-09-17T04:34:28.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.142+0000 7fc34ccd4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3480736d0 0x7fc3481f1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:28.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.142+0000 7fc34d4d5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc34806dec0 0x7fc348152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:28.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.142+0000 7fc34ccd4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3480736d0 0x7fc3481f1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34392/0 (socket says 172.21.15.43:34392) 2024-09-17T04:34:28.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.142+0000 7fc34d4d5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc34806dec0 0x7fc348152130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:44782/0 (socket says 172.21.15.43:44782) 2024-09-17T04:34:28.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.142+0000 7fc34ccd4640 1 -- 172.21.15.43:0/3150583002 learned_addr learned my addr 172.21.15.43:0/3150583002 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:28.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.142+0000 7fc34dcd6640 1 --2- 172.21.15.43:0/3150583002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc348074880 0x7fc3480cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:28.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.142+0000 7fc34ccd4640 1 -- 172.21.15.43:0/3150583002 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc34806dec0 msgr2=0x7fc348152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:28.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.142+0000 7fc34ccd4640 1 --2- 172.21.15.43:0/3150583002 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc34806dec0 0x7fc348152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.142+0000 7fc34ccd4640 1 -- 172.21.15.43:0/3150583002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc348074880 msgr2=0x7fc3480cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:28.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.142+0000 7fc34ccd4640 1 --2- 172.21.15.43:0/3150583002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc348074880 0x7fc3480cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.142+0000 7fc34ccd4640 1 -- 172.21.15.43:0/3150583002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3481f2330 con 0x7fc3480736d0 2024-09-17T04:34:28.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.142+0000 7fc34d4d5640 1 --2- 172.21.15.43:0/3150583002 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc34806dec0 0x7fc348152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:34:28.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.142+0000 7fc34ccd4640 1 --2- 172.21.15.43:0/3150583002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3480736d0 0x7fc3481f1df0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc34400c3c0 tx=0x7fc34400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:28.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.142+0000 7fc339ffb640 1 -- 172.21.15.43:0/3150583002 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344011790 con 0x7fc3480736d0 2024-09-17T04:34:28.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.142+0000 7fc339ffb640 1 -- 172.21.15.43:0/3150583002 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc344017070 con 0x7fc3480736d0 2024-09-17T04:34:28.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.142+0000 7fc34f739640 1 -- 172.21.15.43:0/3150583002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc348152770 con 0x7fc3480736d0 2024-09-17T04:34:28.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.142+0000 7fc339ffb640 1 -- 172.21.15.43:0/3150583002 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344011ce0 con 0x7fc3480736d0 2024-09-17T04:34:28.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.143+0000 7fc34f739640 1 -- 172.21.15.43:0/3150583002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3480cc300 con 0x7fc3480736d0 2024-09-17T04:34:28.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.143+0000 7fc339ffb640 1 -- 172.21.15.43:0/3150583002 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc34401c460 con 0x7fc3480736d0 2024-09-17T04:34:28.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.143+0000 7fc339ffb640 1 -- 172.21.15.43:0/3150583002 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc3440128f0 con 0x7fc3480736d0 2024-09-17T04:34:28.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.143+0000 7fc34f739640 1 -- 172.21.15.43:0/3150583002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc348158630 con 0x7fc3480736d0 2024-09-17T04:34:28.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.147+0000 7fc339ffb640 1 -- 172.21.15.43:0/3150583002 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc344012b80 con 0x7fc3480736d0 2024-09-17T04:34:28.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.213+0000 7fc34f739640 1 -- 172.21.15.43:0/3150583002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fc3481e2e30 con 0x7fc3480736d0 2024-09-17T04:34:28.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.215+0000 7fc339ffb640 1 -- 172.21.15.43:0/3150583002 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fc344012d60 con 0x7fc3480736d0 2024-09-17T04:34:28.215 INFO:teuthology.orchestra.run.smithi043.stderr:adjusted tunables profile to default 2024-09-17T04:34:28.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.216+0000 7fc34f739640 1 -- 172.21.15.43:0/3150583002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3480736d0 msgr2=0x7fc3481f1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:28.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.216+0000 7fc34f739640 1 --2- 172.21.15.43:0/3150583002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3480736d0 0x7fc3481f1df0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc34400c3c0 tx=0x7fc34400c880 comp rx=0 tx=0).stop 2024-09-17T04:34:28.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.216+0000 7fc34f739640 1 -- 172.21.15.43:0/3150583002 shutdown_connections 2024-09-17T04:34:28.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.216+0000 7fc34f739640 1 --2- 172.21.15.43:0/3150583002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc348074880 0x7fc3480cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.216+0000 7fc34f739640 1 --2- 172.21.15.43:0/3150583002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3480736d0 0x7fc3481f1df0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.216+0000 7fc34f739640 1 --2- 172.21.15.43:0/3150583002 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc34806dec0 0x7fc348152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.216+0000 7fc34f739640 1 -- 172.21.15.43:0/3150583002 >> 172.21.15.43:0/3150583002 conn(0x7fc348071a00 msgr2=0x7fc3480c4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:28.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.216+0000 7fc34f739640 1 -- 172.21.15.43:0/3150583002 shutdown_connections 2024-09-17T04:34:28.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:28.216+0000 7fc34f739640 1 -- 172.21.15.43:0/3150583002 wait complete. 2024-09-17T04:34:28.227 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T04:34:28.227 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T04:34:28.227 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:34:28.227 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T04:34:28.252 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:34:28.252 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T04:34:28.319 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:34:28.319 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T04:34:28.384 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:34:28.384 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T04:34:28.450 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:34:28.450 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T04:34:28.475 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:34:28.476 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T04:34:28.540 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:34:28.540 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T04:34:28.606 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-17T04:34:28.606 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T04:34:28.670 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new eaab925a-60b4-429f-aee1-50de6f32358d 0 2024-09-17T04:34:28.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.825+0000 7f8f7d3a1640 1 -- 172.21.15.62:0/1531246027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f780736d0 msgr2=0x7f8f780c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:28.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.825+0000 7f8f7d3a1640 1 --2- 172.21.15.62:0/1531246027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f780736d0 0x7f8f780c2ed0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8f780750f0 tx=0x7f8f6c02a5d0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.825+0000 7f8f7d3a1640 1 -- 172.21.15.62:0/1531246027 shutdown_connections 2024-09-17T04:34:28.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.825+0000 7f8f7d3a1640 1 --2- 172.21.15.62:0/1531246027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f780736d0 0x7f8f780c2ed0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.825+0000 7f8f7d3a1640 1 --2- 172.21.15.62:0/1531246027 >> v2:172.21.15.62:3300/0 conn(0x7f8f78074880 0x7f8f78155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.825+0000 7f8f7d3a1640 1 -- 172.21.15.62:0/1531246027 >> 172.21.15.62:0/1531246027 conn(0x7f8f78071a00 msgr2=0x7f8f780cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:28.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.825+0000 7f8f7d3a1640 1 -- 172.21.15.62:0/1531246027 shutdown_connections 2024-09-17T04:34:28.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.825+0000 7f8f7d3a1640 1 -- 172.21.15.62:0/1531246027 wait complete. 2024-09-17T04:34:28.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.827+0000 7f8f7d3a1640 1 Processor -- start 2024-09-17T04:34:28.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.827+0000 7f8f7d3a1640 1 -- start start 2024-09-17T04:34:28.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.828+0000 7f8f7d3a1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f7806dec0 0x7f8f781efbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:28.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.828+0000 7f8f7d3a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f780736d0 0x7f8f780c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:28.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.828+0000 7f8f7d3a1640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f78074880 0x7f8f780c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:28.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.828+0000 7f8f7d3a1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8f780b3f30 con 0x7f8f7806dec0 2024-09-17T04:34:28.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.828+0000 7f8f7d3a1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8f780ce380 con 0x7f8f780736d0 2024-09-17T04:34:28.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.828+0000 7f8f7d3a1640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8f781585e0 con 0x7f8f78074880 2024-09-17T04:34:28.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.829+0000 7f8f767fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f780736d0 0x7f8f780c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:28.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.829+0000 7f8f777fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f78074880 0x7f8f780c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:28.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.829+0000 7f8f767fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f780736d0 0x7f8f780c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50388/0 (socket says 172.21.15.62:50388) 2024-09-17T04:34:28.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.829+0000 7f8f767fc640 1 -- 172.21.15.62:0/2457598667 learned_addr learned my addr 172.21.15.62:0/2457598667 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-17T04:34:28.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.829+0000 7f8f76ffd640 1 --2- 172.21.15.62:0/2457598667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f7806dec0 0x7f8f781efbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:28.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.829+0000 7f8f777fe640 1 -- 172.21.15.62:0/2457598667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f780736d0 msgr2=0x7f8f780c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:28.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.829+0000 7f8f777fe640 1 --2- 172.21.15.62:0/2457598667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f780736d0 0x7f8f780c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.829+0000 7f8f777fe640 1 -- 172.21.15.62:0/2457598667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f7806dec0 msgr2=0x7f8f781efbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.829+0000 7f8f777fe640 1 --2- 172.21.15.62:0/2457598667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f7806dec0 0x7f8f781efbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.829+0000 7f8f777fe640 1 -- 172.21.15.62:0/2457598667 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f781f0100 con 0x7f8f78074880 2024-09-17T04:34:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.829+0000 7f8f767fc640 1 --2- 172.21.15.62:0/2457598667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f780736d0 0x7f8f780c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:34:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.829+0000 7f8f777fe640 1 --2- 172.21.15.62:0/2457598667 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f78074880 0x7f8f780c5450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8f7000c730 tx=0x7f8f7000cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.829+0000 7f8f5f7fe640 1 -- 172.21.15.62:0/2457598667 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f70003b70 con 0x7f8f78074880 2024-09-17T04:34:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.829+0000 7f8f5f7fe640 1 -- 172.21.15.62:0/2457598667 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f70003d10 con 0x7f8f78074880 2024-09-17T04:34:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.829+0000 7f8f7d3a1640 1 -- 172.21.15.62:0/2457598667 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f7814ce40 con 0x7f8f78074880 2024-09-17T04:34:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.829+0000 7f8f5f7fe640 1 -- 172.21.15.62:0/2457598667 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f70005330 con 0x7f8f78074880 2024-09-17T04:34:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.829+0000 7f8f7d3a1640 1 -- 172.21.15.62:0/2457598667 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f780c6590 con 0x7f8f78074880 2024-09-17T04:34:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.830+0000 7f8f5f7fe640 1 -- 172.21.15.62:0/2457598667 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8f700056e0 con 0x7f8f78074880 2024-09-17T04:34:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.830+0000 7f8f5f7fe640 1 -- 172.21.15.62:0/2457598667 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f8f70012ac0 con 0x7f8f78074880 2024-09-17T04:34:28.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.831+0000 7f8f7d3a1640 1 -- 172.21.15.62:0/2457598667 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f780c7d60 con 0x7f8f78074880 2024-09-17T04:34:28.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.833+0000 7f8f5f7fe640 1 -- 172.21.15.62:0/2457598667 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8f7000a640 con 0x7f8f78074880 2024-09-17T04:34:28.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.905+0000 7f8f7d3a1640 1 -- 172.21.15.62:0/2457598667 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "eaab925a-60b4-429f-aee1-50de6f32358d", "id": 0} v 0) -- 0x7f8f78158200 con 0x7f8f78074880 2024-09-17T04:34:28.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.909+0000 7f8f5f7fe640 1 -- 172.21.15.62:0/2457598667 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eaab925a-60b4-429f-aee1-50de6f32358d", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f8f7000a8f0 con 0x7f8f78074880 2024-09-17T04:34:28.908 INFO:teuthology.orchestra.run.smithi062.stdout:0 2024-09-17T04:34:28.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.910+0000 7f8f7d3a1640 1 -- 172.21.15.62:0/2457598667 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f78074880 msgr2=0x7f8f780c5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:28.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.910+0000 7f8f7d3a1640 1 --2- 172.21.15.62:0/2457598667 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f78074880 0x7f8f780c5450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8f7000c730 tx=0x7f8f7000cbf0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.910+0000 7f8f7d3a1640 1 -- 172.21.15.62:0/2457598667 shutdown_connections 2024-09-17T04:34:28.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.910+0000 7f8f7d3a1640 1 --2- 172.21.15.62:0/2457598667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f780736d0 0x7f8f780c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.910+0000 7f8f7d3a1640 1 --2- 172.21.15.62:0/2457598667 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f78074880 0x7f8f780c5450 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.910+0000 7f8f7d3a1640 1 --2- 172.21.15.62:0/2457598667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f7806dec0 0x7f8f781efbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:28.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.910+0000 7f8f7d3a1640 1 -- 172.21.15.62:0/2457598667 >> 172.21.15.62:0/2457598667 conn(0x7f8f78071a00 msgr2=0x7f8f7814fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:28.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.910+0000 7f8f7d3a1640 1 -- 172.21.15.62:0/2457598667 shutdown_connections 2024-09-17T04:34:28.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:28.910+0000 7f8f7d3a1640 1 -- 172.21.15.62:0/2457598667 wait complete. 2024-09-17T04:34:28.920 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 2c0e64be-db05-45db-aad8-2f2f42812100 1 2024-09-17T04:34:29.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.034+0000 7fdd4ef8b640 1 -- 172.21.15.62:0/2053484455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd48074880 msgr2=0x7fdd48155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.034+0000 7fdd4ef8b640 1 --2- 172.21.15.62:0/2053484455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd48074880 0x7fdd48155c40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdd4806e9e0 tx=0x7fdd3c02a5f0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.034+0000 7fdd4ef8b640 1 -- 172.21.15.62:0/2053484455 shutdown_connections 2024-09-17T04:34:29.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.034+0000 7fdd4ef8b640 1 --2- 172.21.15.62:0/2053484455 >> v2:172.21.15.43:3300/0 conn(0x7fdd480736d0 0x7fdd480c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.034+0000 7fdd4ef8b640 1 --2- 172.21.15.62:0/2053484455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd48074880 0x7fdd48155c40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.034+0000 7fdd4ef8b640 1 -- 172.21.15.62:0/2053484455 >> 172.21.15.62:0/2053484455 conn(0x7fdd48071a00 msgr2=0x7fdd480cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:29.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.034+0000 7fdd4ef8b640 1 -- 172.21.15.62:0/2053484455 shutdown_connections 2024-09-17T04:34:29.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.034+0000 7fdd4ef8b640 1 -- 172.21.15.62:0/2053484455 wait complete. 2024-09-17T04:34:29.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.036+0000 7fdd4ef8b640 1 Processor -- start 2024-09-17T04:34:29.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.036+0000 7fdd4ef8b640 1 -- start start 2024-09-17T04:34:29.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.037+0000 7fdd4ef8b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd4806dec0 0x7fdd48152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:29.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.037+0000 7fdd4ef8b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd480736d0 0x7fdd481f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:29.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.037+0000 7fdd4ef8b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd48074880 0x7fdd4806cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:29.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.037+0000 7fdd4ef8b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdd480b3f30 con 0x7fdd480736d0 2024-09-17T04:34:29.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.037+0000 7fdd4ef8b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdd480ce380 con 0x7fdd48074880 2024-09-17T04:34:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.037+0000 7fdd4ef8b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdd481585e0 con 0x7fdd4806dec0 2024-09-17T04:34:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.037+0000 7fdd4d528640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd48074880 0x7fdd4806cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.037+0000 7fdd4cd27640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd4806dec0 0x7fdd48152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.037+0000 7fdd4d528640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd48074880 0x7fdd4806cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50392/0 (socket says 172.21.15.62:50392) 2024-09-17T04:34:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.037+0000 7fdd4cd27640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd4806dec0 0x7fdd48152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:43348/0 (socket says 172.21.15.62:43348) 2024-09-17T04:34:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.037+0000 7fdd4d528640 1 -- 172.21.15.62:0/1204485385 learned_addr learned my addr 172.21.15.62:0/1204485385 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-17T04:34:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.037+0000 7fdd47fff640 1 --2- 172.21.15.62:0/1204485385 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd480736d0 0x7fdd481f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.038+0000 7fdd4cd27640 1 -- 172.21.15.62:0/1204485385 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd48074880 msgr2=0x7fdd4806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.038+0000 7fdd4cd27640 1 --2- 172.21.15.62:0/1204485385 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd48074880 0x7fdd4806cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.038+0000 7fdd4cd27640 1 -- 172.21.15.62:0/1204485385 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd480736d0 msgr2=0x7fdd481f2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.038+0000 7fdd4cd27640 1 --2- 172.21.15.62:0/1204485385 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd480736d0 0x7fdd481f2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.038+0000 7fdd4cd27640 1 -- 172.21.15.62:0/1204485385 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd481f2760 con 0x7fdd4806dec0 2024-09-17T04:34:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.038+0000 7fdd47fff640 1 --2- 172.21.15.62:0/1204485385 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd480736d0 0x7fdd481f2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:34:29.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.038+0000 7fdd4d528640 1 --2- 172.21.15.62:0/1204485385 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd48074880 0x7fdd4806cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:34:29.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.038+0000 7fdd4cd27640 1 --2- 172.21.15.62:0/1204485385 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd4806dec0 0x7fdd48152030 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c031000 tx=0x7fdd3c0038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:29.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.038+0000 7fdd457fa640 1 -- 172.21.15.62:0/1204485385 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c03e030 con 0x7fdd4806dec0 2024-09-17T04:34:29.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.038+0000 7fdd457fa640 1 -- 172.21.15.62:0/1204485385 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd3c003d90 con 0x7fdd4806dec0 2024-09-17T04:34:29.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.038+0000 7fdd457fa640 1 -- 172.21.15.62:0/1204485385 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c035040 con 0x7fdd4806dec0 2024-09-17T04:34:29.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.038+0000 7fdd4ef8b640 1 -- 172.21.15.62:0/1204485385 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd4814f980 con 0x7fdd4806dec0 2024-09-17T04:34:29.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.038+0000 7fdd4ef8b640 1 -- 172.21.15.62:0/1204485385 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd4814ff40 con 0x7fdd4806dec0 2024-09-17T04:34:29.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.039+0000 7fdd457fa640 1 -- 172.21.15.62:0/1204485385 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdd3c041030 con 0x7fdd4806dec0 2024-09-17T04:34:29.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.039+0000 7fdd457fa640 1 -- 172.21.15.62:0/1204485385 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fdd3c043bf0 con 0x7fdd4806dec0 2024-09-17T04:34:29.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.040+0000 7fdd4ef8b640 1 -- 172.21.15.62:0/1204485385 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd480c7d60 con 0x7fdd4806dec0 2024-09-17T04:34:29.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.042+0000 7fdd457fa640 1 -- 172.21.15.62:0/1204485385 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fdd3c004f20 con 0x7fdd4806dec0 2024-09-17T04:34:29.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.114+0000 7fdd4ef8b640 1 -- 172.21.15.62:0/1204485385 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2c0e64be-db05-45db-aad8-2f2f42812100", "id": 1} v 0) -- 0x7fdd480c88e0 con 0x7fdd4806dec0 2024-09-17T04:34:29.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.117+0000 7fdd457fa640 1 -- 172.21.15.62:0/1204485385 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2c0e64be-db05-45db-aad8-2f2f42812100", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fdd3c04d440 con 0x7fdd4806dec0 2024-09-17T04:34:29.117 INFO:teuthology.orchestra.run.smithi062.stdout:1 2024-09-17T04:34:29.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.118+0000 7fdd4ef8b640 1 -- 172.21.15.62:0/1204485385 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd4806dec0 msgr2=0x7fdd48152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.118+0000 7fdd4ef8b640 1 --2- 172.21.15.62:0/1204485385 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd4806dec0 0x7fdd48152030 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c031000 tx=0x7fdd3c0038a0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.118+0000 7fdd4ef8b640 1 -- 172.21.15.62:0/1204485385 shutdown_connections 2024-09-17T04:34:29.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.118+0000 7fdd4ef8b640 1 --2- 172.21.15.62:0/1204485385 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd48074880 0x7fdd4806cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.118+0000 7fdd4ef8b640 1 --2- 172.21.15.62:0/1204485385 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd480736d0 0x7fdd481f2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.118+0000 7fdd4ef8b640 1 --2- 172.21.15.62:0/1204485385 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd4806dec0 0x7fdd48152030 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.118+0000 7fdd4ef8b640 1 -- 172.21.15.62:0/1204485385 >> 172.21.15.62:0/1204485385 conn(0x7fdd48071a00 msgr2=0x7fdd481573e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:29.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.118+0000 7fdd4ef8b640 1 -- 172.21.15.62:0/1204485385 shutdown_connections 2024-09-17T04:34:29.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.118+0000 7fdd4ef8b640 1 -- 172.21.15.62:0/1204485385 wait complete. 2024-09-17T04:34:29.128 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new fa88665d-2acb-4e44-99ac-1d496adf5b94 2 2024-09-17T04:34:29.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.241+0000 7f5c166b2640 1 -- 172.21.15.62:0/2214258380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c100c55e0 msgr2=0x7f5c10074810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.241+0000 7f5c166b2640 1 --2- 172.21.15.62:0/2214258380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c100c55e0 0x7f5c10074810 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5c04005fd0 tx=0x7f5c0402a670 comp rx=0 tx=0).stop 2024-09-17T04:34:29.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.241+0000 7f5c166b2640 1 -- 172.21.15.62:0/2214258380 shutdown_connections 2024-09-17T04:34:29.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.241+0000 7f5c166b2640 1 --2- 172.21.15.62:0/2214258380 >> v2:172.21.15.43:3300/0 conn(0x7f5c10074d50 0x7f5c10151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.241+0000 7f5c166b2640 1 --2- 172.21.15.62:0/2214258380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c100c55e0 0x7f5c10074810 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.241+0000 7f5c166b2640 1 -- 172.21.15.62:0/2214258380 >> 172.21.15.62:0/2214258380 conn(0x7f5c1006cdb0 msgr2=0x7f5c1006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:29.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.241+0000 7f5c166b2640 1 -- 172.21.15.62:0/2214258380 shutdown_connections 2024-09-17T04:34:29.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.241+0000 7f5c166b2640 1 -- 172.21.15.62:0/2214258380 wait complete. 2024-09-17T04:34:29.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.243+0000 7f5c166b2640 1 Processor -- start 2024-09-17T04:34:29.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.243+0000 7f5c166b2640 1 -- start start 2024-09-17T04:34:29.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.244+0000 7f5c166b2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c10072ee0 0x7f5c101465d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:29.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.244+0000 7f5c166b2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c10074d50 0x7f5c1014e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:29.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.244+0000 7f5c166b2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c100c55e0 0x7f5c10142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:29.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.244+0000 7f5c166b2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1006f8a0 con 0x7f5c10074d50 2024-09-17T04:34:29.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.244+0000 7f5c166b2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5c10075160 con 0x7f5c10072ee0 2024-09-17T04:34:29.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.244+0000 7f5c166b2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5c100c4750 con 0x7f5c100c55e0 2024-09-17T04:34:29.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.245+0000 7f5c14c4f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c100c55e0 0x7f5c10142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:29.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.245+0000 7f5c0ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c10072ee0 0x7f5c101465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:29.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.245+0000 7f5c14c4f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c100c55e0 0x7f5c10142b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:43354/0 (socket says 172.21.15.62:43354) 2024-09-17T04:34:29.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.245+0000 7f5c14c4f640 1 -- 172.21.15.62:0/925658875 learned_addr learned my addr 172.21.15.62:0/925658875 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-17T04:34:29.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.245+0000 7f5c0f7fe640 1 --2- 172.21.15.62:0/925658875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c10074d50 0x7f5c1014e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:29.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.245+0000 7f5c14c4f640 1 -- 172.21.15.62:0/925658875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c10072ee0 msgr2=0x7f5c101465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.245+0000 7f5c14c4f640 1 --2- 172.21.15.62:0/925658875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c10072ee0 0x7f5c101465d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.245+0000 7f5c14c4f640 1 -- 172.21.15.62:0/925658875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c10074d50 msgr2=0x7f5c1014e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.245+0000 7f5c14c4f640 1 --2- 172.21.15.62:0/925658875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c10074d50 0x7f5c1014e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.245+0000 7f5c14c4f640 1 -- 172.21.15.62:0/925658875 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c101e1e80 con 0x7f5c100c55e0 2024-09-17T04:34:29.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.245+0000 7f5c0ffff640 1 --2- 172.21.15.62:0/925658875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c10072ee0 0x7f5c101465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:34:29.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.245+0000 7f5c0f7fe640 1 --2- 172.21.15.62:0/925658875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c10074d50 0x7f5c1014e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:34:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.245+0000 7f5c14c4f640 1 --2- 172.21.15.62:0/925658875 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c100c55e0 0x7f5c10142b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800ea70 tx=0x7f5c0800ef30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.245+0000 7f5c0cff9640 1 -- 172.21.15.62:0/925658875 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0800ce40 con 0x7f5c100c55e0 2024-09-17T04:34:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.245+0000 7f5c0cff9640 1 -- 172.21.15.62:0/925658875 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c08004c10 con 0x7f5c100c55e0 2024-09-17T04:34:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.245+0000 7f5c0cff9640 1 -- 172.21.15.62:0/925658875 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08005020 con 0x7f5c100c55e0 2024-09-17T04:34:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.245+0000 7f5c166b2640 1 -- 172.21.15.62:0/925658875 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c101e3580 con 0x7f5c100c55e0 2024-09-17T04:34:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.246+0000 7f5c166b2640 1 -- 172.21.15.62:0/925658875 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c101e1830 con 0x7f5c100c55e0 2024-09-17T04:34:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.246+0000 7f5c0cff9640 1 -- 172.21.15.62:0/925658875 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5c08005550 con 0x7f5c100c55e0 2024-09-17T04:34:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.246+0000 7f5c0cff9640 1 -- 172.21.15.62:0/925658875 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f5c08010850 con 0x7f5c100c55e0 2024-09-17T04:34:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.247+0000 7f5c166b2640 1 -- 172.21.15.62:0/925658875 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c100c5250 con 0x7f5c100c55e0 2024-09-17T04:34:29.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.249+0000 7f5c0cff9640 1 -- 172.21.15.62:0/925658875 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5c08027080 con 0x7f5c100c55e0 2024-09-17T04:34:29.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.342+0000 7f5c166b2640 1 -- 172.21.15.62:0/925658875 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fa88665d-2acb-4e44-99ac-1d496adf5b94", "id": 2} v 0) -- 0x7f5c10146330 con 0x7f5c100c55e0 2024-09-17T04:34:29.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.345+0000 7f5c0cff9640 1 -- 172.21.15.62:0/925658875 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa88665d-2acb-4e44-99ac-1d496adf5b94", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f5c08010430 con 0x7f5c100c55e0 2024-09-17T04:34:29.345 INFO:teuthology.orchestra.run.smithi062.stdout:2 2024-09-17T04:34:29.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.346+0000 7f5c166b2640 1 -- 172.21.15.62:0/925658875 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c100c55e0 msgr2=0x7f5c10142b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.346+0000 7f5c166b2640 1 --2- 172.21.15.62:0/925658875 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c100c55e0 0x7f5c10142b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800ea70 tx=0x7f5c0800ef30 comp rx=0 tx=0).stop 2024-09-17T04:34:29.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.346+0000 7f5c166b2640 1 -- 172.21.15.62:0/925658875 shutdown_connections 2024-09-17T04:34:29.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.346+0000 7f5c166b2640 1 --2- 172.21.15.62:0/925658875 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c100c55e0 0x7f5c10142b90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.346+0000 7f5c166b2640 1 --2- 172.21.15.62:0/925658875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c10074d50 0x7f5c1014e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.346+0000 7f5c166b2640 1 --2- 172.21.15.62:0/925658875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c10072ee0 0x7f5c101465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.346+0000 7f5c166b2640 1 -- 172.21.15.62:0/925658875 >> 172.21.15.62:0/925658875 conn(0x7f5c1006cdb0 msgr2=0x7f5c100c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:29.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.346+0000 7f5c166b2640 1 -- 172.21.15.62:0/925658875 shutdown_connections 2024-09-17T04:34:29.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.346+0000 7f5c166b2640 1 -- 172.21.15.62:0/925658875 wait complete. 2024-09-17T04:34:29.356 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 710a28f0-d04a-4b4a-bba3-28f7c7b1eb99 3 2024-09-17T04:34:29.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.470+0000 7f51851b0640 1 -- 172.21.15.62:0/2586418204 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51800736d0 msgr2=0x7f5180155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.470+0000 7f51851b0640 1 --2- 172.21.15.62:0/2586418204 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51800736d0 0x7f5180155c40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5170009830 tx=0x7f517002a510 comp rx=0 tx=0).stop 2024-09-17T04:34:29.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.470+0000 7f51851b0640 1 -- 172.21.15.62:0/2586418204 shutdown_connections 2024-09-17T04:34:29.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.470+0000 7f51851b0640 1 --2- 172.21.15.62:0/2586418204 >> v2:172.21.15.62:3300/0 conn(0x7f518006dec0 0x7f518006e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.470+0000 7f51851b0640 1 --2- 172.21.15.62:0/2586418204 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51800736d0 0x7f5180155c40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.470+0000 7f51851b0640 1 -- 172.21.15.62:0/2586418204 >> 172.21.15.62:0/2586418204 conn(0x7f5180071a00 msgr2=0x7f51800cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:29.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.470+0000 7f51851b0640 1 -- 172.21.15.62:0/2586418204 shutdown_connections 2024-09-17T04:34:29.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.470+0000 7f51851b0640 1 -- 172.21.15.62:0/2586418204 wait complete. 2024-09-17T04:34:29.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.472+0000 7f51851b0640 1 Processor -- start 2024-09-17T04:34:29.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.472+0000 7f51851b0640 1 -- start start 2024-09-17T04:34:29.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.473+0000 7f51851b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f518006dec0 0x7f51801f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:29.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.473+0000 7f51851b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51800736d0 0x7f51800c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:29.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.473+0000 7f51851b0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5180074880 0x7f5180150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:29.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.473+0000 7f51851b0640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f51800ce380 con 0x7f518006dec0 2024-09-17T04:34:29.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.473+0000 7f51851b0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5180158bf0 con 0x7f51800736d0 2024-09-17T04:34:29.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.473+0000 7f51851b0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f51800b3f30 con 0x7f5180074880 2024-09-17T04:34:29.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.473+0000 7f517f59e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5180074880 0x7f5180150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:29.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.473+0000 7f517f59e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5180074880 0x7f5180150450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:54498/0 (socket says 172.21.15.62:54498) 2024-09-17T04:34:29.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.473+0000 7f517e59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51800736d0 0x7f51800c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:29.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.473+0000 7f517f59e640 1 -- 172.21.15.62:0/65367999 learned_addr learned my addr 172.21.15.62:0/65367999 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-17T04:34:29.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.473+0000 7f517ed9d640 1 --2- 172.21.15.62:0/65367999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f518006dec0 0x7f51801f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:29.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.474+0000 7f517f59e640 1 -- 172.21.15.62:0/65367999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51800736d0 msgr2=0x7f51800c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.474+0000 7f517f59e640 1 --2- 172.21.15.62:0/65367999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51800736d0 0x7f51800c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.474+0000 7f517f59e640 1 -- 172.21.15.62:0/65367999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f518006dec0 msgr2=0x7f51801f0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.474+0000 7f517f59e640 1 --2- 172.21.15.62:0/65367999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f518006dec0 0x7f51801f0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.474+0000 7f517f59e640 1 -- 172.21.15.62:0/65367999 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51801f0660 con 0x7f5180074880 2024-09-17T04:34:29.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.474+0000 7f517e59c640 1 --2- 172.21.15.62:0/65367999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51800736d0 0x7f51800c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:34:29.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.474+0000 7f517ed9d640 1 --2- 172.21.15.62:0/65367999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f518006dec0 0x7f51801f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:34:29.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.474+0000 7f517f59e640 1 --2- 172.21.15.62:0/65367999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5180074880 0x7f5180150450 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f517800ef30 tx=0x7f517800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:29.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.474+0000 7f51677fe640 1 -- 172.21.15.62:0/65367999 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178003970 con 0x7f5180074880 2024-09-17T04:34:29.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.474+0000 7f51677fe640 1 -- 172.21.15.62:0/65367999 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5178003c00 con 0x7f5180074880 2024-09-17T04:34:29.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.474+0000 7f51851b0640 1 -- 172.21.15.62:0/65367999 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51801f34d0 con 0x7f5180074880 2024-09-17T04:34:29.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.474+0000 7f51677fe640 1 -- 172.21.15.62:0/65367999 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178004020 con 0x7f5180074880 2024-09-17T04:34:29.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.474+0000 7f51851b0640 1 -- 172.21.15.62:0/65367999 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f51801f3a50 con 0x7f5180074880 2024-09-17T04:34:29.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.474+0000 7f51677fe640 1 -- 172.21.15.62:0/65367999 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5178004b40 con 0x7f5180074880 2024-09-17T04:34:29.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.474+0000 7f51677fe640 1 -- 172.21.15.62:0/65367999 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f517800bd70 con 0x7f5180074880 2024-09-17T04:34:29.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.475+0000 7f51851b0640 1 -- 172.21.15.62:0/65367999 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5180156220 con 0x7f5180074880 2024-09-17T04:34:29.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.477+0000 7f51677fe640 1 -- 172.21.15.62:0/65367999 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5180156220 con 0x7f5180074880 2024-09-17T04:34:29.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.550+0000 7f51851b0640 1 -- 172.21.15.62:0/65367999 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "710a28f0-d04a-4b4a-bba3-28f7c7b1eb99", "id": 3} v 0) -- 0x7f51801585e0 con 0x7f5180074880 2024-09-17T04:34:29.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.553+0000 7f51677fe640 1 -- 172.21.15.62:0/65367999 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "710a28f0-d04a-4b4a-bba3-28f7c7b1eb99", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f5178024070 con 0x7f5180074880 2024-09-17T04:34:29.552 INFO:teuthology.orchestra.run.smithi062.stdout:3 2024-09-17T04:34:29.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.554+0000 7f51851b0640 1 -- 172.21.15.62:0/65367999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5180074880 msgr2=0x7f5180150450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.554+0000 7f51851b0640 1 --2- 172.21.15.62:0/65367999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5180074880 0x7f5180150450 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f517800ef30 tx=0x7f517800c800 comp rx=0 tx=0).stop 2024-09-17T04:34:29.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.554+0000 7f51851b0640 1 -- 172.21.15.62:0/65367999 shutdown_connections 2024-09-17T04:34:29.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.554+0000 7f51851b0640 1 --2- 172.21.15.62:0/65367999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51800736d0 0x7f51800c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.554+0000 7f51851b0640 1 --2- 172.21.15.62:0/65367999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5180074880 0x7f5180150450 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.554+0000 7f51851b0640 1 --2- 172.21.15.62:0/65367999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f518006dec0 0x7f51801f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.554+0000 7f51851b0640 1 -- 172.21.15.62:0/65367999 >> 172.21.15.62:0/65367999 conn(0x7f5180071a00 msgr2=0x7f51800c8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:29.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.554+0000 7f51851b0640 1 -- 172.21.15.62:0/65367999 shutdown_connections 2024-09-17T04:34:29.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.554+0000 7f51851b0640 1 -- 172.21.15.62:0/65367999 wait complete. 2024-09-17T04:34:29.564 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new d2eca96b-1917-4dbb-b6e3-f4410bbc5c51 4 2024-09-17T04:34:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.678+0000 7f0798027640 1 -- 172.21.15.62:0/2185799860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0790074880 msgr2=0x7f0790155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.678+0000 7f0798027640 1 --2- 172.21.15.62:0/2185799860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0790074880 0x7f0790155c40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f079006e9e0 tx=0x7f078402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.678+0000 7f0798027640 1 -- 172.21.15.62:0/2185799860 shutdown_connections 2024-09-17T04:34:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.678+0000 7f0798027640 1 --2- 172.21.15.62:0/2185799860 >> v2:172.21.15.43:3300/0 conn(0x7f07900736d0 0x7f07900c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.678+0000 7f0798027640 1 --2- 172.21.15.62:0/2185799860 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f079006dec0 0x7f079006e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.678+0000 7f0798027640 1 --2- 172.21.15.62:0/2185799860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0790074880 0x7f0790155c40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.678+0000 7f0798027640 1 -- 172.21.15.62:0/2185799860 >> 172.21.15.62:0/2185799860 conn(0x7f0790071a00 msgr2=0x7f07900cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:29.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.678+0000 7f0798027640 1 -- 172.21.15.62:0/2185799860 shutdown_connections 2024-09-17T04:34:29.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.678+0000 7f0798027640 1 -- 172.21.15.62:0/2185799860 wait complete. 2024-09-17T04:34:29.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.680+0000 7f0798027640 1 Processor -- start 2024-09-17T04:34:29.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.680+0000 7f0798027640 1 -- start start 2024-09-17T04:34:29.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.681+0000 7f0798027640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f079006dec0 0x7f07901e2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:29.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.681+0000 7f0798027640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07900736d0 0x7f0790150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:29.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.681+0000 7f0798027640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0790074880 0x7f079006cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:29.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.681+0000 7f0798027640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f07900b3f30 con 0x7f0790074880 2024-09-17T04:34:29.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.681+0000 7f0798027640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f07900ce380 con 0x7f07900736d0 2024-09-17T04:34:29.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.681+0000 7f0798027640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f07901585e0 con 0x7f079006dec0 2024-09-17T04:34:29.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.681+0000 7f0795dc3640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f079006dec0 0x7f07901e2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:29.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.681+0000 7f0795dc3640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f079006dec0 0x7f07901e2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:54514/0 (socket says 172.21.15.62:54514) 2024-09-17T04:34:29.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.681+0000 7f0795dc3640 1 -- 172.21.15.62:0/4060213009 learned_addr learned my addr 172.21.15.62:0/4060213009 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-17T04:34:29.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.681+0000 7f07955c2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07900736d0 0x7f0790150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:29.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.681+0000 7f07965c4640 1 --2- 172.21.15.62:0/4060213009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0790074880 0x7f079006cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:29.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.682+0000 7f0795dc3640 1 -- 172.21.15.62:0/4060213009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07900736d0 msgr2=0x7f0790150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.682+0000 7f0795dc3640 1 --2- 172.21.15.62:0/4060213009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07900736d0 0x7f0790150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.682+0000 7f0795dc3640 1 -- 172.21.15.62:0/4060213009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0790074880 msgr2=0x7f079006cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.682+0000 7f0795dc3640 1 --2- 172.21.15.62:0/4060213009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0790074880 0x7f079006cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.682+0000 7f0795dc3640 1 -- 172.21.15.62:0/4060213009 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07901e31c0 con 0x7f079006dec0 2024-09-17T04:34:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.682+0000 7f07955c2640 1 --2- 172.21.15.62:0/4060213009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07900736d0 0x7f0790150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:34:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.682+0000 7f07965c4640 1 --2- 172.21.15.62:0/4060213009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0790074880 0x7f079006cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:34:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.682+0000 7f0795dc3640 1 --2- 172.21.15.62:0/4060213009 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f079006dec0 0x7f07901e2c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0784009920 tx=0x7f0784033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.682+0000 7f07827fc640 1 -- 172.21.15.62:0/4060213009 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784031d60 con 0x7f079006dec0 2024-09-17T04:34:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.682+0000 7f07827fc640 1 -- 172.21.15.62:0/4060213009 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0784033e10 con 0x7f079006dec0 2024-09-17T04:34:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.682+0000 7f0798027640 1 -- 172.21.15.62:0/4060213009 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07901f2200 con 0x7f079006dec0 2024-09-17T04:34:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.682+0000 7f07827fc640 1 -- 172.21.15.62:0/4060213009 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784005260 con 0x7f079006dec0 2024-09-17T04:34:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.682+0000 7f0798027640 1 -- 172.21.15.62:0/4060213009 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f07901f27a0 con 0x7f079006dec0 2024-09-17T04:34:29.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.682+0000 7f07827fc640 1 -- 172.21.15.62:0/4060213009 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f07840047a0 con 0x7f079006dec0 2024-09-17T04:34:29.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.682+0000 7f07827fc640 1 -- 172.21.15.62:0/4060213009 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f07840035f0 con 0x7f079006dec0 2024-09-17T04:34:29.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.683+0000 7f0798027640 1 -- 172.21.15.62:0/4060213009 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f079006f090 con 0x7f079006dec0 2024-09-17T04:34:29.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.685+0000 7f07827fc640 1 -- 172.21.15.62:0/4060213009 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f078403f030 con 0x7f079006dec0 2024-09-17T04:34:29.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.757+0000 7f0798027640 1 -- 172.21.15.62:0/4060213009 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d2eca96b-1917-4dbb-b6e3-f4410bbc5c51", "id": 4} v 0) -- 0x7f07900c7d60 con 0x7f079006dec0 2024-09-17T04:34:29.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.761+0000 7f07827fc640 1 -- 172.21.15.62:0/4060213009 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2eca96b-1917-4dbb-b6e3-f4410bbc5c51", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f0784004c20 con 0x7f079006dec0 2024-09-17T04:34:29.760 INFO:teuthology.orchestra.run.smithi062.stdout:4 2024-09-17T04:34:29.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.762+0000 7f0798027640 1 -- 172.21.15.62:0/4060213009 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f079006dec0 msgr2=0x7f07901e2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.762+0000 7f0798027640 1 --2- 172.21.15.62:0/4060213009 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f079006dec0 0x7f07901e2c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0784009920 tx=0x7f0784033c20 comp rx=0 tx=0).stop 2024-09-17T04:34:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.762+0000 7f0798027640 1 -- 172.21.15.62:0/4060213009 shutdown_connections 2024-09-17T04:34:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.762+0000 7f0798027640 1 --2- 172.21.15.62:0/4060213009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07900736d0 0x7f0790150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.762+0000 7f0798027640 1 --2- 172.21.15.62:0/4060213009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0790074880 0x7f079006cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.762+0000 7f0798027640 1 --2- 172.21.15.62:0/4060213009 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f079006dec0 0x7f07901e2c80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.762+0000 7f0798027640 1 -- 172.21.15.62:0/4060213009 >> 172.21.15.62:0/4060213009 conn(0x7f0790071a00 msgr2=0x7f079014ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.762+0000 7f0798027640 1 -- 172.21.15.62:0/4060213009 shutdown_connections 2024-09-17T04:34:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.762+0000 7f0798027640 1 -- 172.21.15.62:0/4060213009 wait complete. 2024-09-17T04:34:29.772 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new ae843bea-38ff-4ca6-a7a9-6e58c7a17fd7 5 2024-09-17T04:34:29.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.885+0000 7fe6ae29b640 1 -- 172.21.15.62:0/1066563075 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a806dec0 msgr2=0x7fe6a806e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.885+0000 7fe6ae29b640 1 --2- 172.21.15.62:0/1066563075 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a806dec0 0x7fe6a806e2d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0005fd0 tx=0x7fe6a002aa90 comp rx=0 tx=0).stop 2024-09-17T04:34:29.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.885+0000 7fe6ae29b640 1 -- 172.21.15.62:0/1066563075 shutdown_connections 2024-09-17T04:34:29.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.885+0000 7fe6ae29b640 1 --2- 172.21.15.62:0/1066563075 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a806dec0 0x7fe6a806e2d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.885+0000 7fe6ae29b640 1 --2- 172.21.15.62:0/1066563075 >> v2:172.21.15.43:3300/0 conn(0x7fe6a80736d0 0x7fe6a8155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.885+0000 7fe6ae29b640 1 -- 172.21.15.62:0/1066563075 >> 172.21.15.62:0/1066563075 conn(0x7fe6a8071a00 msgr2=0x7fe6a80cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:29.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.885+0000 7fe6ae29b640 1 -- 172.21.15.62:0/1066563075 shutdown_connections 2024-09-17T04:34:29.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.885+0000 7fe6ae29b640 1 -- 172.21.15.62:0/1066563075 wait complete. 2024-09-17T04:34:29.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.888+0000 7fe6ae29b640 1 Processor -- start 2024-09-17T04:34:29.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.888+0000 7fe6ae29b640 1 -- start start 2024-09-17T04:34:29.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.890+0000 7fe6ae29b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6a806dec0 0x7fe6a80c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:29.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.890+0000 7fe6ae29b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a80736d0 0x7fe6a80ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:29.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.890+0000 7fe6ae29b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6a8074880 0x7fe6a81f1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:29.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.890+0000 7fe6ae29b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a80ce380 con 0x7fe6a806dec0 2024-09-17T04:34:29.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.890+0000 7fe6ae29b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a8158bf0 con 0x7fe6a8074880 2024-09-17T04:34:29.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.890+0000 7fe6ae29b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a80b3f30 con 0x7fe6a80736d0 2024-09-17T04:34:29.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.890+0000 7fe6a77fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a80736d0 0x7fe6a80ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:29.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.890+0000 7fe6a77fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a80736d0 0x7fe6a80ca850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:54524/0 (socket says 172.21.15.62:54524) 2024-09-17T04:34:29.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.890+0000 7fe6a77fe640 1 -- 172.21.15.62:0/4140442478 learned_addr learned my addr 172.21.15.62:0/4140442478 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-17T04:34:29.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.890+0000 7fe6ac838640 1 --2- 172.21.15.62:0/4140442478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6a8074880 0x7fe6a81f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:29.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.890+0000 7fe6a7fff640 1 --2- 172.21.15.62:0/4140442478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6a806dec0 0x7fe6a80c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:29.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.890+0000 7fe6a77fe640 1 -- 172.21.15.62:0/4140442478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6a8074880 msgr2=0x7fe6a81f1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.890+0000 7fe6a77fe640 1 --2- 172.21.15.62:0/4140442478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6a8074880 0x7fe6a81f1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.890+0000 7fe6a77fe640 1 -- 172.21.15.62:0/4140442478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6a806dec0 msgr2=0x7fe6a80c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.890+0000 7fe6a77fe640 1 --2- 172.21.15.62:0/4140442478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6a806dec0 0x7fe6a80c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.890+0000 7fe6a77fe640 1 -- 172.21.15.62:0/4140442478 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a80c4bd0 con 0x7fe6a80736d0 2024-09-17T04:34:29.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.891+0000 7fe6a77fe640 1 --2- 172.21.15.62:0/4140442478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a80736d0 0x7fe6a80ca850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00e790 tx=0x7fe69c00ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:29.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.891+0000 7fe6a4ff9640 1 -- 172.21.15.62:0/4140442478 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c00eea0 con 0x7fe6a80736d0 2024-09-17T04:34:29.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.891+0000 7fe6a4ff9640 1 -- 172.21.15.62:0/4140442478 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe69c00cdb0 con 0x7fe6a80736d0 2024-09-17T04:34:29.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.891+0000 7fe6ae29b640 1 -- 172.21.15.62:0/4140442478 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a80c78a0 con 0x7fe6a80736d0 2024-09-17T04:34:29.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.891+0000 7fe6a4ff9640 1 -- 172.21.15.62:0/4140442478 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c004280 con 0x7fe6a80736d0 2024-09-17T04:34:29.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.891+0000 7fe6ae29b640 1 -- 172.21.15.62:0/4140442478 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a8154c20 con 0x7fe6a80736d0 2024-09-17T04:34:29.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.891+0000 7fe6a4ff9640 1 -- 172.21.15.62:0/4140442478 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe69c020020 con 0x7fe6a80736d0 2024-09-17T04:34:29.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.891+0000 7fe6a4ff9640 1 -- 172.21.15.62:0/4140442478 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fe69c003b70 con 0x7fe6a80736d0 2024-09-17T04:34:29.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.892+0000 7fe6ae29b640 1 -- 172.21.15.62:0/4140442478 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a8154a10 con 0x7fe6a80736d0 2024-09-17T04:34:29.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.894+0000 7fe6a4ff9640 1 -- 172.21.15.62:0/4140442478 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe69c027070 con 0x7fe6a80736d0 2024-09-17T04:34:29.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.966+0000 7fe6ae29b640 1 -- 172.21.15.62:0/4140442478 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ae843bea-38ff-4ca6-a7a9-6e58c7a17fd7", "id": 5} v 0) -- 0x7fe6a81585e0 con 0x7fe6a80736d0 2024-09-17T04:34:29.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.969+0000 7fe6a4ff9640 1 -- 172.21.15.62:0/4140442478 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ae843bea-38ff-4ca6-a7a9-6e58c7a17fd7", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fe69c004420 con 0x7fe6a80736d0 2024-09-17T04:34:29.969 INFO:teuthology.orchestra.run.smithi062.stdout:5 2024-09-17T04:34:29.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.970+0000 7fe6ae29b640 1 -- 172.21.15.62:0/4140442478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a80736d0 msgr2=0x7fe6a80ca850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:29.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.970+0000 7fe6ae29b640 1 --2- 172.21.15.62:0/4140442478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a80736d0 0x7fe6a80ca850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00e790 tx=0x7fe69c00ec50 comp rx=0 tx=0).stop 2024-09-17T04:34:29.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.970+0000 7fe6ae29b640 1 -- 172.21.15.62:0/4140442478 shutdown_connections 2024-09-17T04:34:29.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.970+0000 7fe6ae29b640 1 --2- 172.21.15.62:0/4140442478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6a8074880 0x7fe6a81f1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.970+0000 7fe6ae29b640 1 --2- 172.21.15.62:0/4140442478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a80736d0 0x7fe6a80ca850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.970+0000 7fe6ae29b640 1 --2- 172.21.15.62:0/4140442478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6a806dec0 0x7fe6a80c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:29.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.970+0000 7fe6ae29b640 1 -- 172.21.15.62:0/4140442478 >> 172.21.15.62:0/4140442478 conn(0x7fe6a8071a00 msgr2=0x7fe6a81528d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:29.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.970+0000 7fe6ae29b640 1 -- 172.21.15.62:0/4140442478 shutdown_connections 2024-09-17T04:34:29.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:29.970+0000 7fe6ae29b640 1 -- 172.21.15.62:0/4140442478 wait complete. 2024-09-17T04:34:29.980 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 44c53356-010d-443f-9e8d-f0d5da106893 6 2024-09-17T04:34:30.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.094+0000 7f2f142fa640 1 -- 172.21.15.62:0/152104846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f0c070da0 msgr2=0x7f2f0c1539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:30.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.094+0000 7f2f142fa640 1 --2- 172.21.15.62:0/152104846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f0c070da0 0x7f2f0c1539e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2f00005fd0 tx=0x7f2f0002a670 comp rx=0 tx=0).stop 2024-09-17T04:34:30.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.094+0000 7f2f142fa640 1 -- 172.21.15.62:0/152104846 shutdown_connections 2024-09-17T04:34:30.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.094+0000 7f2f142fa640 1 --2- 172.21.15.62:0/152104846 >> v2:172.21.15.43:3300/0 conn(0x7f2f0c0c5c70 0x7f2f0c0ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.094+0000 7f2f142fa640 1 --2- 172.21.15.62:0/152104846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f0c070da0 0x7f2f0c1539e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.094+0000 7f2f142fa640 1 -- 172.21.15.62:0/152104846 >> 172.21.15.62:0/152104846 conn(0x7f2f0c0cef30 msgr2=0x7f2f0c0cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:30.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.094+0000 7f2f142fa640 1 -- 172.21.15.62:0/152104846 shutdown_connections 2024-09-17T04:34:30.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.094+0000 7f2f142fa640 1 -- 172.21.15.62:0/152104846 wait complete. 2024-09-17T04:34:30.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.096+0000 7f2f142fa640 1 Processor -- start 2024-09-17T04:34:30.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.096+0000 7f2f142fa640 1 -- start start 2024-09-17T04:34:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.097+0000 7f2f142fa640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f0c070da0 0x7f2f0c1f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.097+0000 7f2f142fa640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f0c0c5c70 0x7f2f0c1e4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.097+0000 7f2f142fa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f0c0cb390 0x7f2f0c1e0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.097+0000 7f2f142fa640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c0c43b0 con 0x7f2f0c0c5c70 2024-09-17T04:34:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.097+0000 7f2f142fa640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c0c40d0 con 0x7f2f0c0cb390 2024-09-17T04:34:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.097+0000 7f2f142fa640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2f0c0ca040 con 0x7f2f0c070da0 2024-09-17T04:34:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.097+0000 7f2f12096640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f0c070da0 0x7f2f0c1f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.097+0000 7f2f12897640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f0c0cb390 0x7f2f0c1e0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.097+0000 7f2f12096640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f0c070da0 0x7f2f0c1f2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:54544/0 (socket says 172.21.15.62:54544) 2024-09-17T04:34:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.097+0000 7f2f11895640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f0c0c5c70 0x7f2f0c1e4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.097+0000 7f2f12096640 1 -- 172.21.15.62:0/2891343471 learned_addr learned my addr 172.21.15.62:0/2891343471 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-17T04:34:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.097+0000 7f2f12897640 1 -- 172.21.15.62:0/2891343471 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f0c070da0 msgr2=0x7f2f0c1f2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.097+0000 7f2f12897640 1 --2- 172.21.15.62:0/2891343471 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f0c070da0 0x7f2f0c1f2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.097+0000 7f2f12897640 1 -- 172.21.15.62:0/2891343471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f0c0c5c70 msgr2=0x7f2f0c1e4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.097+0000 7f2f12897640 1 --2- 172.21.15.62:0/2891343471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f0c0c5c70 0x7f2f0c1e4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.097+0000 7f2f12897640 1 -- 172.21.15.62:0/2891343471 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f0c1f20d0 con 0x7f2f0c0cb390 2024-09-17T04:34:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.097+0000 7f2f11895640 1 --2- 172.21.15.62:0/2891343471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f0c0c5c70 0x7f2f0c1e4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:34:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.098+0000 7f2f12897640 1 --2- 172.21.15.62:0/2891343471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f0c0cb390 0x7f2f0c1e0940 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400e9e0 tx=0x7f2f0400eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:30.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.098+0000 7f2efeffd640 1 -- 172.21.15.62:0/2891343471 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0400cdb0 con 0x7f2f0c0cb390 2024-09-17T04:34:30.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.098+0000 7f2efeffd640 1 -- 172.21.15.62:0/2891343471 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f04004b20 con 0x7f2f0c0cb390 2024-09-17T04:34:30.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.098+0000 7f2f142fa640 1 -- 172.21.15.62:0/2891343471 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f0c14df60 con 0x7f2f0c0cb390 2024-09-17T04:34:30.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.098+0000 7f2efeffd640 1 -- 172.21.15.62:0/2891343471 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04005020 con 0x7f2f0c0cb390 2024-09-17T04:34:30.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.098+0000 7f2f142fa640 1 -- 172.21.15.62:0/2891343471 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f0c1529a0 con 0x7f2f0c0cb390 2024-09-17T04:34:30.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.098+0000 7f2efeffd640 1 -- 172.21.15.62:0/2891343471 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2f04005550 con 0x7f2f0c0cb390 2024-09-17T04:34:30.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.098+0000 7f2efeffd640 1 -- 172.21.15.62:0/2891343471 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f2f04010a20 con 0x7f2f0c0cb390 2024-09-17T04:34:30.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.099+0000 7f2f142fa640 1 -- 172.21.15.62:0/2891343471 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f0c1f22a0 con 0x7f2f0c0cb390 2024-09-17T04:34:30.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.101+0000 7f2efeffd640 1 -- 172.21.15.62:0/2891343471 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2f04018e20 con 0x7f2f0c0cb390 2024-09-17T04:34:30.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.174+0000 7f2f142fa640 1 -- 172.21.15.62:0/2891343471 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "44c53356-010d-443f-9e8d-f0d5da106893", "id": 6} v 0) -- 0x7f2f0c1539e0 con 0x7f2f0c0cb390 2024-09-17T04:34:30.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.177+0000 7f2efeffd640 1 -- 172.21.15.62:0/2891343471 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44c53356-010d-443f-9e8d-f0d5da106893", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f2f04010cc0 con 0x7f2f0c0cb390 2024-09-17T04:34:30.177 INFO:teuthology.orchestra.run.smithi062.stdout:6 2024-09-17T04:34:30.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.178+0000 7f2f142fa640 1 -- 172.21.15.62:0/2891343471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f0c0cb390 msgr2=0x7f2f0c1e0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:30.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.178+0000 7f2f142fa640 1 --2- 172.21.15.62:0/2891343471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f0c0cb390 0x7f2f0c1e0940 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400e9e0 tx=0x7f2f0400eea0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.178+0000 7f2f142fa640 1 -- 172.21.15.62:0/2891343471 shutdown_connections 2024-09-17T04:34:30.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.178+0000 7f2f142fa640 1 --2- 172.21.15.62:0/2891343471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f0c0cb390 0x7f2f0c1e0940 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.178+0000 7f2f142fa640 1 --2- 172.21.15.62:0/2891343471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f0c0c5c70 0x7f2f0c1e4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.178+0000 7f2f142fa640 1 --2- 172.21.15.62:0/2891343471 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f0c070da0 0x7f2f0c1f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.178+0000 7f2f142fa640 1 -- 172.21.15.62:0/2891343471 >> 172.21.15.62:0/2891343471 conn(0x7f2f0c0cef30 msgr2=0x7f2f0c0cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:30.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.178+0000 7f2f142fa640 1 -- 172.21.15.62:0/2891343471 shutdown_connections 2024-09-17T04:34:30.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.178+0000 7f2f142fa640 1 -- 172.21.15.62:0/2891343471 wait complete. 2024-09-17T04:34:30.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new c8960d11-dd10-4e36-b9d8-f1fdc0abe9c2 7 2024-09-17T04:34:30.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.301+0000 7fa120c8b640 1 -- 172.21.15.62:0/1169924793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa11c074880 msgr2=0x7fa11c155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:30.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.301+0000 7fa120c8b640 1 --2- 172.21.15.62:0/1169924793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa11c074880 0x7fa11c155c40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009830 tx=0x7fa10c02a5c0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.302+0000 7fa120c8b640 1 -- 172.21.15.62:0/1169924793 shutdown_connections 2024-09-17T04:34:30.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.302+0000 7fa120c8b640 1 --2- 172.21.15.62:0/1169924793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa11c074880 0x7fa11c155c40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.302+0000 7fa120c8b640 1 -- 172.21.15.62:0/1169924793 >> 172.21.15.62:0/1169924793 conn(0x7fa11c071a00 msgr2=0x7fa11c0cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:30.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.302+0000 7fa120c8b640 1 -- 172.21.15.62:0/1169924793 shutdown_connections 2024-09-17T04:34:30.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.302+0000 7fa120c8b640 1 -- 172.21.15.62:0/1169924793 wait complete. 2024-09-17T04:34:30.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.304+0000 7fa120c8b640 1 Processor -- start 2024-09-17T04:34:30.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.304+0000 7fa120c8b640 1 -- start start 2024-09-17T04:34:30.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa120c8b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa11c06dec0 0x7fa11c0c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:30.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa120c8b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa11c0736d0 0x7fa11c150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:30.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa120c8b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa11c074880 0x7fa11c0cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:30.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa120c8b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa11c0ce380 con 0x7fa11c074880 2024-09-17T04:34:30.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa120c8b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa11c158bf0 con 0x7fa11c0736d0 2024-09-17T04:34:30.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa120c8b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa11c0b3f30 con 0x7fa11c06dec0 2024-09-17T04:34:30.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa11a59c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa11c06dec0 0x7fa11c0c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:30.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa119d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa11c0736d0 0x7fa11c150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:30.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa11a59c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa11c06dec0 0x7fa11c0c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:54550/0 (socket says 172.21.15.62:54550) 2024-09-17T04:34:30.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa119d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa11c0736d0 0x7fa11c150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52958/0 (socket says 172.21.15.62:52958) 2024-09-17T04:34:30.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa11a59c640 1 -- 172.21.15.62:0/1294222549 learned_addr learned my addr 172.21.15.62:0/1294222549 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-17T04:34:30.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa11ad9d640 1 --2- 172.21.15.62:0/1294222549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa11c074880 0x7fa11c0cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:30.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa119d9b640 1 -- 172.21.15.62:0/1294222549 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa11c06dec0 msgr2=0x7fa11c0c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:30.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa119d9b640 1 --2- 172.21.15.62:0/1294222549 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa11c06dec0 0x7fa11c0c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa119d9b640 1 -- 172.21.15.62:0/1294222549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa11c074880 msgr2=0x7fa11c0cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:30.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa119d9b640 1 --2- 172.21.15.62:0/1294222549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa11c074880 0x7fa11c0cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa119d9b640 1 -- 172.21.15.62:0/1294222549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11c14a5e0 con 0x7fa11c0736d0 2024-09-17T04:34:30.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.305+0000 7fa11ad9d640 1 --2- 172.21.15.62:0/1294222549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa11c074880 0x7fa11c0cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:34:30.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.306+0000 7fa119d9b640 1 --2- 172.21.15.62:0/1294222549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa11c0736d0 0x7fa11c150700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa11000c390 tx=0x7fa11000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:30.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.306+0000 7fa10affd640 1 -- 172.21.15.62:0/1294222549 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa110017070 con 0x7fa11c0736d0 2024-09-17T04:34:30.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.306+0000 7fa10affd640 1 -- 172.21.15.62:0/1294222549 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa110005400 con 0x7fa11c0736d0 2024-09-17T04:34:30.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.306+0000 7fa120c8b640 1 -- 172.21.15.62:0/1294222549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa11c0cd5e0 con 0x7fa11c0736d0 2024-09-17T04:34:30.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.306+0000 7fa10affd640 1 -- 172.21.15.62:0/1294222549 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa110003850 con 0x7fa11c0736d0 2024-09-17T04:34:30.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.306+0000 7fa120c8b640 1 -- 172.21.15.62:0/1294222549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa11c06d3c0 con 0x7fa11c0736d0 2024-09-17T04:34:30.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.306+0000 7fa10affd640 1 -- 172.21.15.62:0/1294222549 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa11001a070 con 0x7fa11c0736d0 2024-09-17T04:34:30.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.306+0000 7fa10affd640 1 -- 172.21.15.62:0/1294222549 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fa110011590 con 0x7fa11c0736d0 2024-09-17T04:34:30.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.307+0000 7fa120c8b640 1 -- 172.21.15.62:0/1294222549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa11c1585e0 con 0x7fa11c0736d0 2024-09-17T04:34:30.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.311+0000 7fa10affd640 1 -- 172.21.15.62:0/1294222549 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa110011790 con 0x7fa11c0736d0 2024-09-17T04:34:30.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.382+0000 7fa120c8b640 1 -- 172.21.15.62:0/1294222549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c8960d11-dd10-4e36-b9d8-f1fdc0abe9c2", "id": 7} v 0) -- 0x7fa11c06ef90 con 0x7fa11c0736d0 2024-09-17T04:34:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.386+0000 7fa10affd640 1 -- 172.21.15.62:0/1294222549 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c8960d11-dd10-4e36-b9d8-f1fdc0abe9c2", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fa110011c30 con 0x7fa11c0736d0 2024-09-17T04:34:30.385 INFO:teuthology.orchestra.run.smithi062.stdout:7 2024-09-17T04:34:30.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.387+0000 7fa120c8b640 1 -- 172.21.15.62:0/1294222549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa11c0736d0 msgr2=0x7fa11c150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:30.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.387+0000 7fa120c8b640 1 --2- 172.21.15.62:0/1294222549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa11c0736d0 0x7fa11c150700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa11000c390 tx=0x7fa11000c850 comp rx=0 tx=0).stop 2024-09-17T04:34:30.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.387+0000 7fa120c8b640 1 -- 172.21.15.62:0/1294222549 shutdown_connections 2024-09-17T04:34:30.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.387+0000 7fa120c8b640 1 --2- 172.21.15.62:0/1294222549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa11c0736d0 0x7fa11c150700 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.387+0000 7fa120c8b640 1 --2- 172.21.15.62:0/1294222549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa11c074880 0x7fa11c0cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.387+0000 7fa120c8b640 1 --2- 172.21.15.62:0/1294222549 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa11c06dec0 0x7fa11c0c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.387+0000 7fa120c8b640 1 -- 172.21.15.62:0/1294222549 >> 172.21.15.62:0/1294222549 conn(0x7fa11c071a00 msgr2=0x7fa11c154700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:30.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.387+0000 7fa120c8b640 1 -- 172.21.15.62:0/1294222549 shutdown_connections 2024-09-17T04:34:30.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-17T04:34:30.387+0000 7fa120c8b640 1 -- 172.21.15.62:0/1294222549 wait complete. 2024-09-17T04:34:30.397 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T04:34:30.397 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T04:34:30.399 INFO:tasks.ceph.osd.0:Started 2024-09-17T04:34:30.400 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T04:34:30.400 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T04:34:30.402 INFO:tasks.ceph.osd.1:Started 2024-09-17T04:34:30.402 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T04:34:30.402 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T04:34:30.404 INFO:tasks.ceph.osd.2:Started 2024-09-17T04:34:30.404 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T04:34:30.404 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T04:34:30.407 INFO:tasks.ceph.osd.3:Started 2024-09-17T04:34:30.407 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T04:34:30.407 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T04:34:30.409 INFO:tasks.ceph.osd.4:Started 2024-09-17T04:34:30.409 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T04:34:30.410 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T04:34:30.412 INFO:tasks.ceph.osd.5:Started 2024-09-17T04:34:30.412 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T04:34:30.412 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T04:34:30.414 INFO:tasks.ceph.osd.6:Started 2024-09-17T04:34:30.414 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T04:34:30.414 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T04:34:30.417 INFO:tasks.ceph.osd.7:Started 2024-09-17T04:34:30.417 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:34:30.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.561+0000 7fd61236a640 1 -- 172.21.15.43:0/4016184030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd60c1535e0 msgr2=0x7fd60c0c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:30.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.561+0000 7fd61236a640 1 --2- 172.21.15.43:0/4016184030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd60c1535e0 0x7fd60c0c6910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc005fd0 tx=0x7fd5fc02a670 comp rx=0 tx=0).stop 2024-09-17T04:34:30.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.562+0000 7fd61236a640 1 -- 172.21.15.43:0/4016184030 shutdown_connections 2024-09-17T04:34:30.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.562+0000 7fd61236a640 1 --2- 172.21.15.43:0/4016184030 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd60c1539f0 0x7fd60c0c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.562+0000 7fd61236a640 1 --2- 172.21.15.43:0/4016184030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd60c1535e0 0x7fd60c0c6910 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.562+0000 7fd61236a640 1 -- 172.21.15.43:0/4016184030 >> 172.21.15.43:0/4016184030 conn(0x7fd60c0738e0 msgr2=0x7fd60c073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:30.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.562+0000 7fd61236a640 1 -- 172.21.15.43:0/4016184030 shutdown_connections 2024-09-17T04:34:30.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.562+0000 7fd61236a640 1 -- 172.21.15.43:0/4016184030 wait complete. 2024-09-17T04:34:30.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.563+0000 7fd61236a640 1 Processor -- start 2024-09-17T04:34:30.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.564+0000 7fd61236a640 1 -- start start 2024-09-17T04:34:30.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.565+0000 7fd61236a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd60c0c7570 0x7fd60c153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:30.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.565+0000 7fd61236a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd60c1535e0 0x7fd60c1efae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:30.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.565+0000 7fd61236a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd60c1539f0 0x7fd60c0ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:30.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.565+0000 7fd61236a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c159650 con 0x7fd60c1539f0 2024-09-17T04:34:30.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.565+0000 7fd61236a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c0c6110 con 0x7fd60c1535e0 2024-09-17T04:34:30.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.565+0000 7fd61236a640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd60c0c5420 con 0x7fd60c0c7570 2024-09-17T04:34:30.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.565+0000 7fd610907640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd60c1539f0 0x7fd60c0ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:30.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.565+0000 7fd610907640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd60c1539f0 0x7fd60c0ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49150/0 (socket says 172.21.15.43:49150) 2024-09-17T04:34:30.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.565+0000 7fd610907640 1 -- 172.21.15.43:0/2014027033 learned_addr learned my addr 172.21.15.43:0/2014027033 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:30.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.565+0000 7fd60bfff640 1 --2- 172.21.15.43:0/2014027033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd60c0c7570 0x7fd60c153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:30.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.565+0000 7fd60b7fe640 1 --2- 172.21.15.43:0/2014027033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd60c1535e0 0x7fd60c1efae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:30.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.565+0000 7fd610907640 1 -- 172.21.15.43:0/2014027033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd60c0c7570 msgr2=0x7fd60c153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:30.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.565+0000 7fd610907640 1 --2- 172.21.15.43:0/2014027033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd60c0c7570 0x7fd60c153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.565+0000 7fd610907640 1 -- 172.21.15.43:0/2014027033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd60c1535e0 msgr2=0x7fd60c1efae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:30.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.565+0000 7fd610907640 1 --2- 172.21.15.43:0/2014027033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd60c1535e0 0x7fd60c1efae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.565+0000 7fd610907640 1 -- 172.21.15.43:0/2014027033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c1f0020 con 0x7fd60c1539f0 2024-09-17T04:34:30.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.565+0000 7fd610907640 1 --2- 172.21.15.43:0/2014027033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd60c1539f0 0x7fd60c0ccf50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd60400c760 tx=0x7fd60400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:30.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.566+0000 7fd608ff9640 1 -- 172.21.15.43:0/2014027033 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604003b90 con 0x7fd60c1539f0 2024-09-17T04:34:30.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.566+0000 7fd608ff9640 1 -- 172.21.15.43:0/2014027033 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd604003d50 con 0x7fd60c1539f0 2024-09-17T04:34:30.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.566+0000 7fd61236a640 1 -- 172.21.15.43:0/2014027033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60c155f40 con 0x7fd60c1539f0 2024-09-17T04:34:30.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.566+0000 7fd608ff9640 1 -- 172.21.15.43:0/2014027033 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60400aab0 con 0x7fd60c1539f0 2024-09-17T04:34:30.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.566+0000 7fd61236a640 1 -- 172.21.15.43:0/2014027033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd60c156500 con 0x7fd60c1539f0 2024-09-17T04:34:30.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.566+0000 7fd608ff9640 1 -- 172.21.15.43:0/2014027033 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd60400ac50 con 0x7fd60c1539f0 2024-09-17T04:34:30.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.566+0000 7fd608ff9640 1 -- 172.21.15.43:0/2014027033 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd604012c30 con 0x7fd60c1539f0 2024-09-17T04:34:30.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.567+0000 7fd61236a640 1 -- 172.21.15.43:0/2014027033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd60c0b3ed0 con 0x7fd60c1539f0 2024-09-17T04:34:30.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.569+0000 7fd608ff9640 1 -- 172.21.15.43:0/2014027033 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd6040050d0 con 0x7fd60c1539f0 2024-09-17T04:34:30.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.630+0000 7fd61236a640 1 -- 172.21.15.43:0/2014027033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd60c154580 con 0x7fd60c1539f0 2024-09-17T04:34:30.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.631+0000 7fd608ff9640 1 -- 172.21.15.43:0/2014027033 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd604005530 con 0x7fd60c1539f0 2024-09-17T04:34:30.631 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:34:30.631 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":10,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","created":"2024-09-17T04:34:26.485007+0000","modified":"2024-09-17T04:34:30.384271+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T04:34:30.384271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"eaab925a-60b4-429f-aee1-50de6f32358d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2c0e64be-db05-45db-aad8-2f2f42812100","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fa88665d-2acb-4e44-99ac-1d496adf5b94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"710a28f0-d04a-4b4a-bba3-28f7c7b1eb99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d2eca96b-1917-4dbb-b6e3-f4410bbc5c51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ae843bea-38ff-4ca6-a7a9-6e58c7a17fd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"44c53356-010d-443f-9e8d-f0d5da106893","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c8960d11-dd10-4e36-b9d8-f1fdc0abe9c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:34:30.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.632+0000 7fd61236a640 1 -- 172.21.15.43:0/2014027033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd60c1539f0 msgr2=0x7fd60c0ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:30.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.632+0000 7fd61236a640 1 --2- 172.21.15.43:0/2014027033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd60c1539f0 0x7fd60c0ccf50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd60400c760 tx=0x7fd60400cc20 comp rx=0 tx=0).stop 2024-09-17T04:34:30.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.632+0000 7fd61236a640 1 -- 172.21.15.43:0/2014027033 shutdown_connections 2024-09-17T04:34:30.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.632+0000 7fd61236a640 1 --2- 172.21.15.43:0/2014027033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd60c1535e0 0x7fd60c1efae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.632+0000 7fd61236a640 1 --2- 172.21.15.43:0/2014027033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd60c1539f0 0x7fd60c0ccf50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.632+0000 7fd61236a640 1 --2- 172.21.15.43:0/2014027033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd60c0c7570 0x7fd60c153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:30.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.632+0000 7fd61236a640 1 -- 172.21.15.43:0/2014027033 >> 172.21.15.43:0/2014027033 conn(0x7fd60c0738e0 msgr2=0x7fd60c158540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:30.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.632+0000 7fd61236a640 1 -- 172.21.15.43:0/2014027033 shutdown_connections 2024-09-17T04:34:30.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:30.632+0000 7fd61236a640 1 -- 172.21.15.43:0/2014027033 wait complete. 2024-09-17T04:34:30.643 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T04:34:30.643 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T04:34:31.398 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-09-17T04:34:31.398+0000 7f19294e6640 -1 Falling back to public interface 2024-09-17T04:34:31.450 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T04:34:31.559 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.557+0000 7f223c4a4640 1 -- 172.21.15.43:0/216673305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234152b40 msgr2=0x7f22340c6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:31.559 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.557+0000 7f223c4a4640 1 --2- 172.21.15.43:0/216673305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234152b40 0x7f22340c6f20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2234072070 tx=0x7f223002a5f0 comp rx=0 tx=0).stop 2024-09-17T04:34:31.559 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.557+0000 7f223c4a4640 1 -- 172.21.15.43:0/216673305 shutdown_connections 2024-09-17T04:34:31.559 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.557+0000 7f223c4a4640 1 --2- 172.21.15.43:0/216673305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234152b40 0x7f22340c6f20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:31.559 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.558+0000 7f223c4a4640 1 --2- 172.21.15.43:0/216673305 >> v2:172.21.15.62:3300/0 conn(0x7f2234074b80 0x7f2234152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:31.559 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.558+0000 7f223c4a4640 1 -- 172.21.15.43:0/216673305 >> 172.21.15.43:0/216673305 conn(0x7f2234070d30 msgr2=0x7f2234071140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:31.559 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.558+0000 7f223c4a4640 1 -- 172.21.15.43:0/216673305 shutdown_connections 2024-09-17T04:34:31.559 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.558+0000 7f223c4a4640 1 -- 172.21.15.43:0/216673305 wait complete. 2024-09-17T04:34:31.560 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.559+0000 7f223c4a4640 1 Processor -- start 2024-09-17T04:34:31.560 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.559+0000 7f223c4a4640 1 -- start start 2024-09-17T04:34:31.563 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f223c4a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234074b80 0x7f22341f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:31.563 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f223c4a4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22340c7460 0x7f223414b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:31.563 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f223c4a4640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2234152b40 0x7f2234144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:31.563 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f223c4a4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f22340c7870 con 0x7f2234074b80 2024-09-17T04:34:31.564 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f223c4a4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f22340c5010 con 0x7f22340c7460 2024-09-17T04:34:31.564 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f223c4a4640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2234074f90 con 0x7f2234152b40 2024-09-17T04:34:31.564 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f223a240640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234074b80 0x7f22341f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:31.564 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f223a240640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234074b80 0x7f22341f51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49166/0 (socket says 172.21.15.43:49166) 2024-09-17T04:34:31.564 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f223a240640 1 -- 172.21.15.43:0/2276933712 learned_addr learned my addr 172.21.15.43:0/2276933712 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:31.564 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f2239a3f640 1 --2- 172.21.15.43:0/2276933712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22340c7460 0x7f223414b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:31.564 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f223aa41640 1 --2- 172.21.15.43:0/2276933712 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2234152b40 0x7f2234144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:31.564 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f223a240640 1 -- 172.21.15.43:0/2276933712 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2234152b40 msgr2=0x7f2234144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:31.564 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f223a240640 1 --2- 172.21.15.43:0/2276933712 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2234152b40 0x7f2234144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:31.564 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f223a240640 1 -- 172.21.15.43:0/2276933712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22340c7460 msgr2=0x7f223414b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:31.564 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f223a240640 1 --2- 172.21.15.43:0/2276933712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22340c7460 0x7f223414b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:31.564 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f223a240640 1 -- 172.21.15.43:0/2276933712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22341f5720 con 0x7f2234074b80 2024-09-17T04:34:31.565 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f223aa41640 1 --2- 172.21.15.43:0/2276933712 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2234152b40 0x7f2234144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:34:31.565 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.561+0000 7f223a240640 1 --2- 172.21.15.43:0/2276933712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234074b80 0x7f22341f51e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f222800d780 tx=0x7f222800dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:31.565 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.562+0000 7f2226ffd640 1 -- 172.21.15.43:0/2276933712 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2228017070 con 0x7f2234074b80 2024-09-17T04:34:31.565 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.562+0000 7f2226ffd640 1 -- 172.21.15.43:0/2276933712 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2228004310 con 0x7f2234074b80 2024-09-17T04:34:31.565 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.562+0000 7f2226ffd640 1 -- 172.21.15.43:0/2276933712 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2228005280 con 0x7f2234074b80 2024-09-17T04:34:31.565 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.562+0000 7f223c4a4640 1 -- 172.21.15.43:0/2276933712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f223415a9f0 con 0x7f2234074b80 2024-09-17T04:34:31.566 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.562+0000 7f223c4a4640 1 -- 172.21.15.43:0/2276933712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f223415b6c0 con 0x7f2234074b80 2024-09-17T04:34:31.566 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.563+0000 7f223c4a4640 1 -- 172.21.15.43:0/2276933712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22340c8a60 con 0x7f2234074b80 2024-09-17T04:34:31.567 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.563+0000 7f2226ffd640 1 -- 172.21.15.43:0/2276933712 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f2228005420 con 0x7f2234074b80 2024-09-17T04:34:31.567 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.563+0000 7f2226ffd640 1 -- 172.21.15.43:0/2276933712 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f2228052710 con 0x7f2234074b80 2024-09-17T04:34:31.567 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.565+0000 7f2226ffd640 1 -- 172.21.15.43:0/2276933712 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2228020020 con 0x7f2234074b80 2024-09-17T04:34:31.629 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.628+0000 7f223c4a4640 1 -- 172.21.15.43:0/2276933712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22340c9880 con 0x7f2234074b80 2024-09-17T04:34:31.629 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.629+0000 7f2226ffd640 1 -- 172.21.15.43:0/2276933712 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f2228016170 con 0x7f2234074b80 2024-09-17T04:34:31.630 INFO:teuthology.misc.health.smithi043.stdout: 2024-09-17T04:34:31.630 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":10,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","created":"2024-09-17T04:34:26.485007+0000","modified":"2024-09-17T04:34:30.384271+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T04:34:30.384271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"eaab925a-60b4-429f-aee1-50de6f32358d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2c0e64be-db05-45db-aad8-2f2f42812100","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fa88665d-2acb-4e44-99ac-1d496adf5b94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"710a28f0-d04a-4b4a-bba3-28f7c7b1eb99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d2eca96b-1917-4dbb-b6e3-f4410bbc5c51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ae843bea-38ff-4ca6-a7a9-6e58c7a17fd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"44c53356-010d-443f-9e8d-f0d5da106893","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c8960d11-dd10-4e36-b9d8-f1fdc0abe9c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:34:31.631 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.630+0000 7f223c4a4640 1 -- 172.21.15.43:0/2276933712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234074b80 msgr2=0x7f22341f51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:31.631 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.630+0000 7f223c4a4640 1 --2- 172.21.15.43:0/2276933712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234074b80 0x7f22341f51e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f222800d780 tx=0x7f222800dc40 comp rx=0 tx=0).stop 2024-09-17T04:34:31.631 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.630+0000 7f223c4a4640 1 -- 172.21.15.43:0/2276933712 shutdown_connections 2024-09-17T04:34:31.631 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.630+0000 7f223c4a4640 1 --2- 172.21.15.43:0/2276933712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22340c7460 0x7f223414b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:31.631 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.630+0000 7f223c4a4640 1 --2- 172.21.15.43:0/2276933712 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2234152b40 0x7f2234144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:31.631 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.630+0000 7f223c4a4640 1 --2- 172.21.15.43:0/2276933712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234074b80 0x7f22341f51e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:31.631 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.630+0000 7f223c4a4640 1 -- 172.21.15.43:0/2276933712 >> 172.21.15.43:0/2276933712 conn(0x7f2234070d30 msgr2=0x7f2234071140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:31.631 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.630+0000 7f223c4a4640 1 -- 172.21.15.43:0/2276933712 shutdown_connections 2024-09-17T04:34:31.631 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:31.630+0000 7f223c4a4640 1 -- 172.21.15.43:0/2276933712 wait complete. 2024-09-17T04:34:31.640 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T04:34:31.650 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-09-17T04:34:31.649+0000 7f488be0d640 -1 Falling back to public interface 2024-09-17T04:34:31.663 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-09-17T04:34:31.662+0000 7fb162e2e640 -1 Falling back to public interface 2024-09-17T04:34:31.892 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-09-17T04:34:31.892+0000 7fcafd1b9640 -1 Falling back to public interface 2024-09-17T04:34:31.895 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-09-17T04:34:31.896+0000 7f82dc9d9640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T04:34:31.896 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-09-17T04:34:31.896+0000 7f84791db640 -1 Falling back to public interface 2024-09-17T04:34:31.896 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-09-17T04:34:31.896+0000 7f82dc9d9640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T04:34:32.099 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-09-17T04:34:32.100+0000 7f534ffbb640 -1 Falling back to public interface 2024-09-17T04:34:32.123 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-09-17T04:34:32.124+0000 7f3e22620640 -1 Falling back to public interface 2024-09-17T04:34:32.135 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-09-17T04:34:32.136+0000 7f92f01a6640 -1 Falling back to public interface 2024-09-17T04:34:34.962 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-09-17T04:34:34.961+0000 7f19294e6640 -1 osd.2 0 log_to_monitors true 2024-09-17T04:34:35.419 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-09-17T04:34:35.418+0000 7fcafd1b9640 -1 osd.1 0 log_to_monitors true 2024-09-17T04:34:35.482 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-09-17T04:34:35.481+0000 7fb162e2e640 -1 osd.0 0 log_to_monitors true 2024-09-17T04:34:35.668 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-09-17T04:34:35.668+0000 7f3e22620640 -1 osd.7 0 log_to_monitors true 2024-09-17T04:34:35.669 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-09-17T04:34:35.669+0000 7f488be0d640 -1 osd.3 0 log_to_monitors true 2024-09-17T04:34:35.708 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-09-17T04:34:35.709+0000 7f92f01a6640 -1 osd.5 0 log_to_monitors true 2024-09-17T04:34:35.861 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-09-17T04:34:35.862+0000 7f534ffbb640 -1 osd.6 0 log_to_monitors true 2024-09-17T04:34:35.951 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-09-17T04:34:35.951+0000 7f84791db640 -1 osd.4 0 log_to_monitors true 2024-09-17T04:34:37.914 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-09-17T04:34:37.913+0000 7fcaf9147640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T04:34:37.923 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-09-17T04:34:37.923+0000 7fcaf0f3d640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:34:37.927 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-09-17T04:34:37.927+0000 7f1925474640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T04:34:37.939 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-09-17T04:34:37.939+0000 7fb15eb99640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T04:34:37.941 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-09-17T04:34:37.941+0000 7f191d26a640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:34:37.954 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-09-17T04:34:37.954+0000 7fb15617a640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:34:38.448 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T04:34:38.558 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.557+0000 7f95a127e640 1 -- 172.21.15.43:0/1247656138 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f959c0b67e0 msgr2=0x7f959c0b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:38.559 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.557+0000 7f95a127e640 1 --2- 172.21.15.43:0/1247656138 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f959c0b67e0 0x7f959c0b46c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9584009830 tx=0x7f958402a5a0 comp rx=0 tx=0).stop 2024-09-17T04:34:38.559 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.557+0000 7f95a127e640 1 -- 172.21.15.43:0/1247656138 shutdown_connections 2024-09-17T04:34:38.559 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.557+0000 7f95a127e640 1 --2- 172.21.15.43:0/1247656138 >> v2:172.21.15.62:3300/0 conn(0x7f959c0cc090 0x7f959c0cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:38.559 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.557+0000 7f95a127e640 1 --2- 172.21.15.43:0/1247656138 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f959c0b67e0 0x7f959c0b46c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:38.559 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.557+0000 7f95a127e640 1 -- 172.21.15.43:0/1247656138 >> 172.21.15.43:0/1247656138 conn(0x7f959c0695e0 msgr2=0x7f959c0cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:38.559 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.557+0000 7f95a127e640 1 -- 172.21.15.43:0/1247656138 shutdown_connections 2024-09-17T04:34:38.559 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.557+0000 7f95a127e640 1 -- 172.21.15.43:0/1247656138 wait complete. 2024-09-17T04:34:38.559 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.559+0000 7f95a127e640 1 Processor -- start 2024-09-17T04:34:38.560 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.559+0000 7f95a127e640 1 -- start start 2024-09-17T04:34:38.562 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.560+0000 7f95a127e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c0b67e0 0x7f959c1f2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:38.562 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.560+0000 7f95a127e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f959c0cc090 0x7f959c1e23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:38.562 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.560+0000 7f95a127e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f959c0cd520 0x7f959c14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:38.562 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.560+0000 7f95a127e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f959c06d7a0 con 0x7f959c0b67e0 2024-09-17T04:34:38.562 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.560+0000 7f95a127e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f959c06d4c0 con 0x7f959c0cd520 2024-09-17T04:34:38.563 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.560+0000 7f95a127e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f959c06da80 con 0x7f959c0cc090 2024-09-17T04:34:38.563 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.560+0000 7f959affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c0b67e0 0x7f959c1f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:38.563 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.560+0000 7f959affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c0b67e0 0x7f959c1f2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49224/0 (socket says 172.21.15.43:49224) 2024-09-17T04:34:38.563 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.560+0000 7f959affd640 1 -- 172.21.15.43:0/1258527684 learned_addr learned my addr 172.21.15.43:0/1258527684 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:38.563 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.560+0000 7f959b7fe640 1 --2- 172.21.15.43:0/1258527684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f959c0cd520 0x7f959c14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:38.563 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.560+0000 7f9593fff640 1 --2- 172.21.15.43:0/1258527684 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f959c0cc090 0x7f959c1e23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:38.563 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.561+0000 7f959affd640 1 -- 172.21.15.43:0/1258527684 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f959c0cc090 msgr2=0x7f959c1e23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:38.563 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.561+0000 7f959affd640 1 --2- 172.21.15.43:0/1258527684 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f959c0cc090 0x7f959c1e23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:38.563 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.561+0000 7f959affd640 1 -- 172.21.15.43:0/1258527684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f959c0cd520 msgr2=0x7f959c14eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:38.563 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.561+0000 7f959affd640 1 --2- 172.21.15.43:0/1258527684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f959c0cd520 0x7f959c14eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:38.563 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.561+0000 7f959affd640 1 -- 172.21.15.43:0/1258527684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c1e2900 con 0x7f959c0b67e0 2024-09-17T04:34:38.563 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.561+0000 7f959b7fe640 1 --2- 172.21.15.43:0/1258527684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f959c0cd520 0x7f959c14eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:34:38.563 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.561+0000 7f959affd640 1 --2- 172.21.15.43:0/1258527684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c0b67e0 0x7f959c1f2620 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f958c00c410 tx=0x7f958c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:38.564 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.561+0000 7f95937fe640 1 -- 172.21.15.43:0/1258527684 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c011790 con 0x7f959c0b67e0 2024-09-17T04:34:38.564 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.561+0000 7f95a127e640 1 -- 172.21.15.43:0/1258527684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959c1e2b10 con 0x7f959c0b67e0 2024-09-17T04:34:38.564 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.561+0000 7f95937fe640 1 -- 172.21.15.43:0/1258527684 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f958c017070 con 0x7f959c0b67e0 2024-09-17T04:34:38.564 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.561+0000 7f95937fe640 1 -- 172.21.15.43:0/1258527684 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c011ca0 con 0x7f959c0b67e0 2024-09-17T04:34:38.564 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.561+0000 7f95a127e640 1 -- 172.21.15.43:0/1258527684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f959c0d15f0 con 0x7f959c0b67e0 2024-09-17T04:34:38.565 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.562+0000 7f95a127e640 1 -- 172.21.15.43:0/1258527684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f959c1e6610 con 0x7f959c0b67e0 2024-09-17T04:34:38.565 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.563+0000 7f95937fe640 1 -- 172.21.15.43:0/1258527684 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7f958c01c460 con 0x7f959c0b67e0 2024-09-17T04:34:38.565 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.563+0000 7f95937fe640 1 --2- 172.21.15.43:0/1258527684 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f957c078b30 0x7f957c07b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:38.565 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.563+0000 7f95937fe640 1 -- 172.21.15.43:0/1258527684 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2231+0+0 (secure 0 0 0) 0x7f958c099bc0 con 0x7f959c0b67e0 2024-09-17T04:34:38.565 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.564+0000 7f9593fff640 1 --2- 172.21.15.43:0/1258527684 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f957c078b30 0x7f957c07b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:38.565 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.564+0000 7f9593fff640 1 --2- 172.21.15.43:0/1258527684 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f957c078b30 0x7f957c07b040 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9584034000 tx=0x7f9584004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:38.573 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.573+0000 7f95937fe640 1 -- 172.21.15.43:0/1258527684 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f958c062eb0 con 0x7f959c0b67e0 2024-09-17T04:34:38.574 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-09-17T04:34:38.574+0000 7f4887eab640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T04:34:38.587 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-09-17T04:34:38.587+0000 7f487f48c640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:34:38.769 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.767+0000 7f95a127e640 1 -- 172.21.15.43:0/1258527684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f959c0cb860 con 0x7f959c0b67e0 2024-09-17T04:34:38.769 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.768+0000 7f95937fe640 1 -- 172.21.15.43:0/1258527684 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8977 (secure 0 0 0) 0x7f958c0627b0 con 0x7f959c0b67e0 2024-09-17T04:34:38.769 INFO:teuthology.misc.health.smithi043.stdout: 2024-09-17T04:34:38.769 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":14,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","created":"2024-09-17T04:34:26.485007+0000","modified":"2024-09-17T04:34:38.616031+0000","last_up_change":"2024-09-17T04:34:38.616031+0000","last_in_change":"2024-09-17T04:34:30.384271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"eaab925a-60b4-429f-aee1-50de6f32358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6817","nonce":1685480205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6819","nonce":1685480205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6823","nonce":1685480205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6821","nonce":1685480205}]},"public_addr":"172.21.15.43:6817/1685480205","cluster_addr":"172.21.15.43:6819/1685480205","heartbeat_back_addr":"172.21.15.43:6823/1685480205","heartbeat_front_addr":"172.21.15.43:6821/1685480205","state":["exists","up"]},{"osd":1,"uuid":"2c0e64be-db05-45db-aad8-2f2f42812100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6825","nonce":1564354446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6827","nonce":1564354446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6831","nonce":1564354446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6829","nonce":1564354446}]},"public_addr":"172.21.15.43:6825/1564354446","cluster_addr":"172.21.15.43:6827/1564354446","heartbeat_back_addr":"172.21.15.43:6831/1564354446","heartbeat_front_addr":"172.21.15.43:6829/1564354446","state":["exists","up"]},{"osd":2,"uuid":"fa88665d-2acb-4e44-99ac-1d496adf5b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6801","nonce":1385342605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6803","nonce":1385342605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6807","nonce":1385342605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6805","nonce":1385342605}]},"public_addr":"172.21.15.43:6801/1385342605","cluster_addr":"172.21.15.43:6803/1385342605","heartbeat_back_addr":"172.21.15.43:6807/1385342605","heartbeat_front_addr":"172.21.15.43:6805/1385342605","state":["exists","up"]},{"osd":3,"uuid":"710a28f0-d04a-4b4a-bba3-28f7c7b1eb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6809","nonce":1646004903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6811","nonce":1646004903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6815","nonce":1646004903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6813","nonce":1646004903}]},"public_addr":"172.21.15.43:6809/1646004903","cluster_addr":"172.21.15.43:6811/1646004903","heartbeat_back_addr":"172.21.15.43:6815/1646004903","heartbeat_front_addr":"172.21.15.43:6813/1646004903","state":["exists","up"]},{"osd":4,"uuid":"d2eca96b-1917-4dbb-b6e3-f4410bbc5c51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ae843bea-38ff-4ca6-a7a9-6e58c7a17fd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"44c53356-010d-443f-9e8d-f0d5da106893","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c8960d11-dd10-4e36-b9d8-f1fdc0abe9c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:34:38.772 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.770+0000 7f95a127e640 1 -- 172.21.15.43:0/1258527684 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f957c078b30 msgr2=0x7f957c07b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:38.772 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.770+0000 7f95a127e640 1 --2- 172.21.15.43:0/1258527684 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f957c078b30 0x7f957c07b040 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9584034000 tx=0x7f9584004730 comp rx=0 tx=0).stop 2024-09-17T04:34:38.772 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.770+0000 7f95a127e640 1 -- 172.21.15.43:0/1258527684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c0b67e0 msgr2=0x7f959c1f2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:38.772 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.770+0000 7f95a127e640 1 --2- 172.21.15.43:0/1258527684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c0b67e0 0x7f959c1f2620 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f958c00c410 tx=0x7f958c00c810 comp rx=0 tx=0).stop 2024-09-17T04:34:38.772 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.770+0000 7f95a127e640 1 -- 172.21.15.43:0/1258527684 shutdown_connections 2024-09-17T04:34:38.772 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.770+0000 7f95a127e640 1 --2- 172.21.15.43:0/1258527684 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f957c078b30 0x7f957c07b040 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:38.772 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.770+0000 7f95a127e640 1 --2- 172.21.15.43:0/1258527684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f959c0cd520 0x7f959c14eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:38.772 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.770+0000 7f95a127e640 1 --2- 172.21.15.43:0/1258527684 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f959c0cc090 0x7f959c1e23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:38.772 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.770+0000 7f95a127e640 1 --2- 172.21.15.43:0/1258527684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c0b67e0 0x7f959c1f2620 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:38.772 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.770+0000 7f95a127e640 1 -- 172.21.15.43:0/1258527684 >> 172.21.15.43:0/1258527684 conn(0x7f959c0695e0 msgr2=0x7f959c151f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:38.773 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.770+0000 7f95a127e640 1 -- 172.21.15.43:0/1258527684 shutdown_connections 2024-09-17T04:34:38.773 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:38.770+0000 7f95a127e640 1 -- 172.21.15.43:0/1258527684 wait complete. 2024-09-17T04:34:38.781 DEBUG:teuthology.misc:4 of 8 OSDs are up 2024-09-17T04:34:39.773 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-09-17T04:34:39.774+0000 7f8475169640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T04:34:39.780 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-09-17T04:34:39.781+0000 7f534c75e640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T04:34:39.786 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-09-17T04:34:39.787+0000 7f846cf5f640 -1 osd.4 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:34:39.792 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-09-17T04:34:39.793+0000 7f5343d3f640 -1 osd.6 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:34:39.801 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-09-17T04:34:39.802+0000 7f3e1df10640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T04:34:39.808 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-09-17T04:34:39.809+0000 7f92ec134640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T04:34:39.816 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-09-17T04:34:39.817+0000 7f3e15d06640 -1 osd.7 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:34:39.824 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-09-17T04:34:39.825+0000 7f92e3f2a640 -1 osd.5 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:34:45.588 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T04:34:45.710 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.709+0000 7f0f7360a640 1 -- 172.21.15.43:0/2536578695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0c9f90 msgr2=0x7f0f6c0ca3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:45.710 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.709+0000 7f0f7360a640 1 --2- 172.21.15.43:0/2536578695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0c9f90 0x7f0f6c0ca3a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009830 tx=0x7f0f6002a5d0 comp rx=0 tx=0).stop 2024-09-17T04:34:45.710 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.709+0000 7f0f7360a640 1 -- 172.21.15.43:0/2536578695 shutdown_connections 2024-09-17T04:34:45.710 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.709+0000 7f0f7360a640 1 --2- 172.21.15.43:0/2536578695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0c9f90 0x7f0f6c0ca3a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:45.710 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.709+0000 7f0f7360a640 1 -- 172.21.15.43:0/2536578695 >> 172.21.15.43:0/2536578695 conn(0x7f0f6c06dec0 msgr2=0x7f0f6c06e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:45.710 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.709+0000 7f0f7360a640 1 -- 172.21.15.43:0/2536578695 shutdown_connections 2024-09-17T04:34:45.710 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.709+0000 7f0f7360a640 1 -- 172.21.15.43:0/2536578695 wait complete. 2024-09-17T04:34:45.711 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.710+0000 7f0f7360a640 1 Processor -- start 2024-09-17T04:34:45.711 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.711+0000 7f0f7360a640 1 -- start start 2024-09-17T04:34:45.714 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.712+0000 7f0f7360a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f6c0c2f40 0x7f0f6c0c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:45.714 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.712+0000 7f0f7360a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0c9030 0x7f0f6c14c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:45.714 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.712+0000 7f0f7360a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f6c0c9f90 0x7f0f6c1f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:45.714 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.712+0000 7f0f7360a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c070830 con 0x7f0f6c0c2f40 2024-09-17T04:34:45.714 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.712+0000 7f0f7360a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c159200 con 0x7f0f6c0c9030 2024-09-17T04:34:45.714 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.712+0000 7f0f7360a640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6c152d90 con 0x7f0f6c0c9f90 2024-09-17T04:34:45.714 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.712+0000 7f0f713a6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f6c0c2f40 0x7f0f6c0c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:45.715 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.712+0000 7f0f713a6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f6c0c2f40 0x7f0f6c0c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47878/0 (socket says 172.21.15.43:47878) 2024-09-17T04:34:45.715 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.712+0000 7f0f713a6640 1 -- 172.21.15.43:0/1711272544 learned_addr learned my addr 172.21.15.43:0/1711272544 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:45.715 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.712+0000 7f0f70ba5640 1 --2- 172.21.15.43:0/1711272544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0c9030 0x7f0f6c14c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:45.715 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.712+0000 7f0f71ba7640 1 --2- 172.21.15.43:0/1711272544 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f6c0c9f90 0x7f0f6c1f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:45.715 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.712+0000 7f0f713a6640 1 -- 172.21.15.43:0/1711272544 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f6c0c9f90 msgr2=0x7f0f6c1f3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:45.715 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.712+0000 7f0f713a6640 1 --2- 172.21.15.43:0/1711272544 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f6c0c9f90 0x7f0f6c1f3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:45.715 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.712+0000 7f0f713a6640 1 -- 172.21.15.43:0/1711272544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0c9030 msgr2=0x7f0f6c14c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:45.715 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.712+0000 7f0f713a6640 1 --2- 172.21.15.43:0/1711272544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0c9030 0x7f0f6c14c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:45.715 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.712+0000 7f0f713a6640 1 -- 172.21.15.43:0/1711272544 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c14cd40 con 0x7f0f6c0c2f40 2024-09-17T04:34:45.715 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.712+0000 7f0f713a6640 1 --2- 172.21.15.43:0/1711272544 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f6c0c2f40 0x7f0f6c0c57e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00cc20 tx=0x7f0f5c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:45.715 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.713+0000 7f0f69ffb640 1 -- 172.21.15.43:0/1711272544 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c016020 con 0x7f0f6c0c2f40 2024-09-17T04:34:45.715 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.713+0000 7f0f69ffb640 1 -- 172.21.15.43:0/1711272544 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f5c012420 con 0x7f0f6c0c2f40 2024-09-17T04:34:45.716 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.713+0000 7f0f69ffb640 1 -- 172.21.15.43:0/1711272544 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c012830 con 0x7f0f6c0c2f40 2024-09-17T04:34:45.716 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.713+0000 7f0f7360a640 1 -- 172.21.15.43:0/1711272544 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6c0c5380 con 0x7f0f6c0c2f40 2024-09-17T04:34:45.716 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.713+0000 7f0f7360a640 1 -- 172.21.15.43:0/1711272544 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6c14c2e0 con 0x7f0f6c0c2f40 2024-09-17T04:34:45.717 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.714+0000 7f0f7360a640 1 -- 172.21.15.43:0/1711272544 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f6c06ed00 con 0x7f0f6c0c2f40 2024-09-17T04:34:45.717 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.715+0000 7f0f69ffb640 1 -- 172.21.15.43:0/1711272544 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f5c019020 con 0x7f0f6c0c2f40 2024-09-17T04:34:45.717 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.716+0000 7f0f69ffb640 1 --2- 172.21.15.43:0/1711272544 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0f58078b90 0x7f0f5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:45.717 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.716+0000 7f0f69ffb640 1 -- 172.21.15.43:0/1711272544 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f0f5c09acf0 con 0x7f0f6c0c2f40 2024-09-17T04:34:45.717 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.716+0000 7f0f70ba5640 1 --2- 172.21.15.43:0/1711272544 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0f58078b90 0x7f0f5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:45.718 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.716+0000 7f0f70ba5640 1 --2- 172.21.15.43:0/1711272544 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0f58078b90 0x7f0f5807b0a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0f60034000 tx=0x7f0f60004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:45.721 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.720+0000 7f0f69ffb640 1 -- 172.21.15.43:0/1711272544 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0f5c09f070 con 0x7f0f6c0c2f40 2024-09-17T04:34:45.909 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.909+0000 7f0f7360a640 1 -- 172.21.15.43:0/1711272544 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f6c076920 con 0x7f0f6c0c2f40 2024-09-17T04:34:45.910 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.909+0000 7f0f69ffb640 1 -- 172.21.15.43:0/1711272544 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12873 (secure 0 0 0) 0x7f0f5c020030 con 0x7f0f6c0c2f40 2024-09-17T04:34:45.910 INFO:teuthology.misc.health.smithi043.stdout: 2024-09-17T04:34:45.910 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":18,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","created":"2024-09-17T04:34:26.485007+0000","modified":"2024-09-17T04:34:42.729062+0000","last_up_change":"2024-09-17T04:34:40.712497+0000","last_in_change":"2024-09-17T04:34:30.384271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:34:38.905735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eaab925a-60b4-429f-aee1-50de6f32358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6817","nonce":1685480205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6819","nonce":1685480205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6823","nonce":1685480205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6821","nonce":1685480205}]},"public_addr":"172.21.15.43:6817/1685480205","cluster_addr":"172.21.15.43:6819/1685480205","heartbeat_back_addr":"172.21.15.43:6823/1685480205","heartbeat_front_addr":"172.21.15.43:6821/1685480205","state":["exists","up"]},{"osd":1,"uuid":"2c0e64be-db05-45db-aad8-2f2f42812100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6825","nonce":1564354446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6827","nonce":1564354446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6831","nonce":1564354446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6829","nonce":1564354446}]},"public_addr":"172.21.15.43:6825/1564354446","cluster_addr":"172.21.15.43:6827/1564354446","heartbeat_back_addr":"172.21.15.43:6831/1564354446","heartbeat_front_addr":"172.21.15.43:6829/1564354446","state":["exists","up"]},{"osd":2,"uuid":"fa88665d-2acb-4e44-99ac-1d496adf5b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6801","nonce":1385342605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6803","nonce":1385342605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6807","nonce":1385342605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6805","nonce":1385342605}]},"public_addr":"172.21.15.43:6801/1385342605","cluster_addr":"172.21.15.43:6803/1385342605","heartbeat_back_addr":"172.21.15.43:6807/1385342605","heartbeat_front_addr":"172.21.15.43:6805/1385342605","state":["exists","up"]},{"osd":3,"uuid":"710a28f0-d04a-4b4a-bba3-28f7c7b1eb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6809","nonce":1646004903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6811","nonce":1646004903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6815","nonce":1646004903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6813","nonce":1646004903}]},"public_addr":"172.21.15.43:6809/1646004903","cluster_addr":"172.21.15.43:6811/1646004903","heartbeat_back_addr":"172.21.15.43:6815/1646004903","heartbeat_front_addr":"172.21.15.43:6813/1646004903","state":["exists","up"]},{"osd":4,"uuid":"d2eca96b-1917-4dbb-b6e3-f4410bbc5c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6803","nonce":3991694106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6805","nonce":3991694106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6809","nonce":3991694106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6807","nonce":3991694106}]},"public_addr":"172.21.15.62:6803/3991694106","cluster_addr":"172.21.15.62:6805/3991694106","heartbeat_back_addr":"172.21.15.62:6809/3991694106","heartbeat_front_addr":"172.21.15.62:6807/3991694106","state":["exists","up"]},{"osd":5,"uuid":"ae843bea-38ff-4ca6-a7a9-6e58c7a17fd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6827","nonce":2558615114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6829","nonce":2558615114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6833","nonce":2558615114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6831","nonce":2558615114}]},"public_addr":"172.21.15.62:6827/2558615114","cluster_addr":"172.21.15.62:6829/2558615114","heartbeat_back_addr":"172.21.15.62:6833/2558615114","heartbeat_front_addr":"172.21.15.62:6831/2558615114","state":["exists","up"]},{"osd":6,"uuid":"44c53356-010d-443f-9e8d-f0d5da106893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6811","nonce":1901653154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6813","nonce":1901653154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6817","nonce":1901653154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6815","nonce":1901653154}]},"public_addr":"172.21.15.62:6811/1901653154","cluster_addr":"172.21.15.62:6813/1901653154","heartbeat_back_addr":"172.21.15.62:6817/1901653154","heartbeat_front_addr":"172.21.15.62:6815/1901653154","state":["exists","up"]},{"osd":7,"uuid":"c8960d11-dd10-4e36-b9d8-f1fdc0abe9c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6819","nonce":2974376041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6821","nonce":2974376041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6825","nonce":2974376041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6823","nonce":2974376041}]},"public_addr":"172.21.15.62:6819/2974376041","cluster_addr":"172.21.15.62:6821/2974376041","heartbeat_back_addr":"172.21.15.62:6825/2974376041","heartbeat_front_addr":"172.21.15.62:6823/2974376041","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.435063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.372079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:35.973575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.690029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.944690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.691776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.877497+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.689786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:34:45.913 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.912+0000 7f0f7360a640 1 -- 172.21.15.43:0/1711272544 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0f58078b90 msgr2=0x7f0f5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:45.913 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.912+0000 7f0f7360a640 1 --2- 172.21.15.43:0/1711272544 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0f58078b90 0x7f0f5807b0a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0f60034000 tx=0x7f0f60004730 comp rx=0 tx=0).stop 2024-09-17T04:34:45.913 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.912+0000 7f0f7360a640 1 -- 172.21.15.43:0/1711272544 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f6c0c2f40 msgr2=0x7f0f6c0c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:45.913 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.912+0000 7f0f7360a640 1 --2- 172.21.15.43:0/1711272544 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f6c0c2f40 0x7f0f6c0c57e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00cc20 tx=0x7f0f5c00a430 comp rx=0 tx=0).stop 2024-09-17T04:34:45.913 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.912+0000 7f0f7360a640 1 -- 172.21.15.43:0/1711272544 shutdown_connections 2024-09-17T04:34:45.913 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.912+0000 7f0f7360a640 1 --2- 172.21.15.43:0/1711272544 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0f58078b90 0x7f0f5807b0a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:45.913 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.912+0000 7f0f7360a640 1 --2- 172.21.15.43:0/1711272544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f6c0c9030 0x7f0f6c14c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:45.913 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.912+0000 7f0f7360a640 1 --2- 172.21.15.43:0/1711272544 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f6c0c9f90 0x7f0f6c1f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:45.914 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.912+0000 7f0f7360a640 1 --2- 172.21.15.43:0/1711272544 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f6c0c2f40 0x7f0f6c0c57e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:45.914 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.912+0000 7f0f7360a640 1 -- 172.21.15.43:0/1711272544 >> 172.21.15.43:0/1711272544 conn(0x7f0f6c06dec0 msgr2=0x7f0f6c073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:45.914 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.912+0000 7f0f7360a640 1 -- 172.21.15.43:0/1711272544 shutdown_connections 2024-09-17T04:34:45.914 INFO:teuthology.misc.health.smithi043.stderr:2024-09-17T04:34:45.912+0000 7f0f7360a640 1 -- 172.21.15.43:0/1711272544 wait complete. 2024-09-17T04:34:45.923 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-17T04:34:45.923 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T04:34:45.923 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T04:34:45.924 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T04:34:45.926 INFO:tasks.ceph.mds.a:Started 2024-09-17T04:34:45.926 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T04:34:45.927 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T04:34:45.929 INFO:tasks.ceph.mds.c:Started 2024-09-17T04:34:45.929 INFO:tasks.ceph.mds.e:Restarting daemon 2024-09-17T04:34:45.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-09-17T04:34:45.931 INFO:tasks.ceph.mds.e:Started 2024-09-17T04:34:45.931 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T04:34:45.931 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T04:34:45.934 INFO:tasks.ceph.mds.b:Started 2024-09-17T04:34:45.935 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T04:34:45.935 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T04:34:45.937 INFO:tasks.ceph.mds.d:Started 2024-09-17T04:34:45.937 INFO:tasks.ceph.mds.f:Restarting daemon 2024-09-17T04:34:45.937 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-09-17T04:34:45.939 INFO:tasks.ceph.mds.f:Started 2024-09-17T04:34:45.940 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-17T04:34:45.940 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:34:46.019 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2024-09-17T04:34:46.020 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2024-09-17T04:34:46.025 INFO:tasks.ceph.mds.e.smithi043.stdout:starting mds.e at 2024-09-17T04:34:46.041 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2024-09-17T04:34:46.041 INFO:tasks.ceph.mds.d.smithi062.stdout:starting mds.d at 2024-09-17T04:34:46.043 INFO:tasks.ceph.mds.f.smithi062.stdout:starting mds.f at 2024-09-17T04:34:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.067+0000 7f56ea982640 1 -- 172.21.15.43:0/1225205085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e4073d60 msgr2=0x7f56e40c6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.067+0000 7f56ea982640 1 --2- 172.21.15.43:0/1225205085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e4073d60 0x7f56e40c6480 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009830 tx=0x7f56d402a540 comp rx=0 tx=0).stop 2024-09-17T04:34:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.068+0000 7f56ea982640 1 -- 172.21.15.43:0/1225205085 shutdown_connections 2024-09-17T04:34:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.068+0000 7f56ea982640 1 --2- 172.21.15.43:0/1225205085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e4073d60 0x7f56e40c6480 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.068+0000 7f56ea982640 1 -- 172.21.15.43:0/1225205085 >> 172.21.15.43:0/1225205085 conn(0x7f56e40cd420 msgr2=0x7f56e40cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.068+0000 7f56ea982640 1 -- 172.21.15.43:0/1225205085 shutdown_connections 2024-09-17T04:34:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.068+0000 7f56ea982640 1 -- 172.21.15.43:0/1225205085 wait complete. 2024-09-17T04:34:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.069+0000 7f56ea982640 1 Processor -- start 2024-09-17T04:34:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.070+0000 7f56ea982640 1 -- start start 2024-09-17T04:34:46.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.071+0000 7f56ea982640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56e4068ee0 0x7f56e41eff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:46.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.071+0000 7f56ea982640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56e4073d60 0x7f56e414c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:46.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.071+0000 7f56ea982640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e4074220 0x7f56e41de920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:46.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.071+0000 7f56ea982640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f56e40c4c00 con 0x7f56e4074220 2024-09-17T04:34:46.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.071+0000 7f56ea982640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f56e40c4920 con 0x7f56e4073d60 2024-09-17T04:34:46.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.071+0000 7f56ea982640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f56e4074e80 con 0x7f56e4068ee0 2024-09-17T04:34:46.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.071+0000 7f56e8f1f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e4074220 0x7f56e41de920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:46.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.071+0000 7f56e8f1f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e4074220 0x7f56e41de920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47932/0 (socket says 172.21.15.43:47932) 2024-09-17T04:34:46.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.071+0000 7f56e8f1f640 1 -- 172.21.15.43:0/490466933 learned_addr learned my addr 172.21.15.43:0/490466933 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:46.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.071+0000 7f56e3fff640 1 --2- 172.21.15.43:0/490466933 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56e4068ee0 0x7f56e41eff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:46.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.071+0000 7f56e37fe640 1 --2- 172.21.15.43:0/490466933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56e4073d60 0x7f56e414c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:46.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.071+0000 7f56e8f1f640 1 -- 172.21.15.43:0/490466933 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56e4068ee0 msgr2=0x7f56e41eff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:46.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.071+0000 7f56e8f1f640 1 --2- 172.21.15.43:0/490466933 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56e4068ee0 0x7f56e41eff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:46.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.071+0000 7f56e8f1f640 1 -- 172.21.15.43:0/490466933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56e4073d60 msgr2=0x7f56e414c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:46.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.071+0000 7f56e8f1f640 1 --2- 172.21.15.43:0/490466933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56e4073d60 0x7f56e414c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:46.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.071+0000 7f56e8f1f640 1 -- 172.21.15.43:0/490466933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e41f04d0 con 0x7f56e4074220 2024-09-17T04:34:46.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.071+0000 7f56e8f1f640 1 --2- 172.21.15.43:0/490466933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e4074220 0x7f56e41de920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00c870 tx=0x7f56dc00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:46.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.072+0000 7f56e0ff9640 1 -- 172.21.15.43:0/490466933 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc017070 con 0x7f56e4074220 2024-09-17T04:34:46.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.072+0000 7f56ea982640 1 -- 172.21.15.43:0/490466933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e41ef7b0 con 0x7f56e4074220 2024-09-17T04:34:46.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.072+0000 7f56e0ff9640 1 -- 172.21.15.43:0/490466933 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56dc005070 con 0x7f56e4074220 2024-09-17T04:34:46.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.072+0000 7f56e0ff9640 1 -- 172.21.15.43:0/490466933 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc0054a0 con 0x7f56e4074220 2024-09-17T04:34:46.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.072+0000 7f56ea982640 1 -- 172.21.15.43:0/490466933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e414d3f0 con 0x7f56e4074220 2024-09-17T04:34:46.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.074+0000 7f56ea982640 1 -- 172.21.15.43:0/490466933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e41f06a0 con 0x7f56e4074220 2024-09-17T04:34:46.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.074+0000 7f56e0ff9640 1 -- 172.21.15.43:0/490466933 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f56dc01a070 con 0x7f56e4074220 2024-09-17T04:34:46.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.074+0000 7f56e0ff9640 1 --2- 172.21.15.43:0/490466933 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56d0078bc0 0x7f56d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:46.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.074+0000 7f56e0ff9640 1 -- 172.21.15.43:0/490466933 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f56dc09a0e0 con 0x7f56e4074220 2024-09-17T04:34:46.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.075+0000 7f56e3fff640 1 --2- 172.21.15.43:0/490466933 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56d0078bc0 0x7f56d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:46.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.075+0000 7f56e3fff640 1 --2- 172.21.15.43:0/490466933 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56d0078bc0 0x7f56d007b0d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f56d4034000 tx=0x7f56d4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:46.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.079+0000 7f56e0ff9640 1 -- 172.21.15.43:0/490466933 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f56dc062230 con 0x7f56e4074220 2024-09-17T04:34:46.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.299+0000 7f56ea982640 1 -- 172.21.15.43:0/490466933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56e414a880 con 0x7f56e4074220 2024-09-17T04:34:46.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.299+0000 7f56e0ff9640 1 -- 172.21.15.43:0/490466933 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1428 (secure 0 0 0) 0x7f56dc066c60 con 0x7f56e4074220 2024-09-17T04:34:46.300 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:34:46.300 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":2,"btime":"2024-09-17T04:34:46:026696+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4431,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/47250523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":47250523},{"type":"v1","addr":"172.21.15.43:6834","nonce":47250523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-17T04:34:46.301 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 2 2024-09-17T04:34:46.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.301+0000 7f56ea982640 1 -- 172.21.15.43:0/490466933 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56d0078bc0 msgr2=0x7f56d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:46.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.301+0000 7f56ea982640 1 --2- 172.21.15.43:0/490466933 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56d0078bc0 0x7f56d007b0d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f56d4034000 tx=0x7f56d4004730 comp rx=0 tx=0).stop 2024-09-17T04:34:46.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.301+0000 7f56ea982640 1 -- 172.21.15.43:0/490466933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e4074220 msgr2=0x7f56e41de920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:46.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.301+0000 7f56ea982640 1 --2- 172.21.15.43:0/490466933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e4074220 0x7f56e41de920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00c870 tx=0x7f56dc00cd30 comp rx=0 tx=0).stop 2024-09-17T04:34:46.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.301+0000 7f56ea982640 1 -- 172.21.15.43:0/490466933 shutdown_connections 2024-09-17T04:34:46.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.301+0000 7f56ea982640 1 --2- 172.21.15.43:0/490466933 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56d0078bc0 0x7f56d007b0d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:46.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.301+0000 7f56ea982640 1 --2- 172.21.15.43:0/490466933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56e4073d60 0x7f56e414c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:46.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.301+0000 7f56ea982640 1 --2- 172.21.15.43:0/490466933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e4074220 0x7f56e41de920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:46.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.301+0000 7f56ea982640 1 --2- 172.21.15.43:0/490466933 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56e4068ee0 0x7f56e41eff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:46.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.301+0000 7f56ea982640 1 -- 172.21.15.43:0/490466933 >> 172.21.15.43:0/490466933 conn(0x7f56e40cd420 msgr2=0x7f56e41562c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:46.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.302+0000 7f56ea982640 1 -- 172.21.15.43:0/490466933 shutdown_connections 2024-09-17T04:34:46.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:46.302+0000 7f56ea982640 1 -- 172.21.15.43:0/490466933 wait complete. 2024-09-17T04:34:48.314 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:34:48.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.446+0000 7f5e6b76a640 1 -- 172.21.15.43:0/730663079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e4c003a00 msgr2=0x7f5e4c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:48.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.446+0000 7f5e6b76a640 1 --2- 172.21.15.43:0/730663079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e4c003a00 0x7f5e4c003e70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c00c4a0 tx=0x7f5e4c005830 comp rx=0 tx=0).stop 2024-09-17T04:34:48.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.446+0000 7f5e69d07640 1 -- 172.21.15.43:0/730663079 reap_dead start 2024-09-17T04:34:48.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.446+0000 7f5e6b76a640 1 -- 172.21.15.43:0/730663079 shutdown_connections 2024-09-17T04:34:48.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.446+0000 7f5e6b76a640 1 -- 172.21.15.43:0/730663079 >> 172.21.15.43:0/730663079 conn(0x7f5e640cefa0 msgr2=0x7f5e640cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:48.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.446+0000 7f5e6b76a640 1 -- 172.21.15.43:0/730663079 shutdown_connections 2024-09-17T04:34:48.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.446+0000 7f5e6b76a640 1 -- 172.21.15.43:0/730663079 wait complete. 2024-09-17T04:34:48.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.448+0000 7f5e6b76a640 1 Processor -- start 2024-09-17T04:34:48.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.448+0000 7f5e6b76a640 1 -- start start 2024-09-17T04:34:48.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.449+0000 7f5e6b76a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e4c003a00 0x7f5e640ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:48.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.449+0000 7f5e6b76a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e640cd880 0x7f5e641e3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:48.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.449+0000 7f5e6b76a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e641468f0 0x7f5e64146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:48.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.449+0000 7f5e6b76a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5e640c4160 con 0x7f5e640cd880 2024-09-17T04:34:48.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.449+0000 7f5e6b76a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5e64071530 con 0x7f5e4c003a00 2024-09-17T04:34:48.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.449+0000 7f5e6b76a640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5e640caee0 con 0x7f5e641468f0 2024-09-17T04:34:48.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.449+0000 7f5e68d05640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e640cd880 0x7f5e641e3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:48.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.449+0000 7f5e68d05640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e640cd880 0x7f5e641e3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47954/0 (socket says 172.21.15.43:47954) 2024-09-17T04:34:48.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.449+0000 7f5e68d05640 1 -- 172.21.15.43:0/3008497524 learned_addr learned my addr 172.21.15.43:0/3008497524 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:48.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.449+0000 7f5e69506640 1 --2- 172.21.15.43:0/3008497524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e4c003a00 0x7f5e640ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:48.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.449+0000 7f5e69d07640 1 --2- 172.21.15.43:0/3008497524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e641468f0 0x7f5e64146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:48.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.449+0000 7f5e68d05640 1 -- 172.21.15.43:0/3008497524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e641468f0 msgr2=0x7f5e64146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:48.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.449+0000 7f5e68d05640 1 --2- 172.21.15.43:0/3008497524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e641468f0 0x7f5e64146d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:48.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.449+0000 7f5e68d05640 1 -- 172.21.15.43:0/3008497524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e4c003a00 msgr2=0x7f5e640ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:48.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.449+0000 7f5e68d05640 1 --2- 172.21.15.43:0/3008497524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e4c003a00 0x7f5e640ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:48.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.449+0000 7f5e68d05640 1 -- 172.21.15.43:0/3008497524 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e640ce970 con 0x7f5e640cd880 2024-09-17T04:34:48.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.450+0000 7f5e68d05640 1 --2- 172.21.15.43:0/3008497524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e640cd880 0x7f5e641e3fc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5e58011ab0 tx=0x7f5e58011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:48.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.450+0000 7f5e61ffb640 1 -- 172.21.15.43:0/3008497524 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5801e070 con 0x7f5e640cd880 2024-09-17T04:34:48.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.450+0000 7f5e61ffb640 1 -- 172.21.15.43:0/3008497524 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e5800fe70 con 0x7f5e640cd880 2024-09-17T04:34:48.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.450+0000 7f5e61ffb640 1 -- 172.21.15.43:0/3008497524 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e580042b0 con 0x7f5e640cd880 2024-09-17T04:34:48.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.450+0000 7f5e6b76a640 1 -- 172.21.15.43:0/3008497524 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e640c78f0 con 0x7f5e640cd880 2024-09-17T04:34:48.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.450+0000 7f5e6b76a640 1 -- 172.21.15.43:0/3008497524 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e640c7eb0 con 0x7f5e640cd880 2024-09-17T04:34:48.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.451+0000 7f5e6b76a640 1 -- 172.21.15.43:0/3008497524 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e64071e00 con 0x7f5e640cd880 2024-09-17T04:34:48.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.452+0000 7f5e61ffb640 1 -- 172.21.15.43:0/3008497524 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5e58021070 con 0x7f5e640cd880 2024-09-17T04:34:48.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.452+0000 7f5e61ffb640 1 --2- 172.21.15.43:0/3008497524 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5e50078bc0 0x7f5e5007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:48.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.452+0000 7f5e61ffb640 1 -- 172.21.15.43:0/3008497524 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f5e5809b370 con 0x7f5e640cd880 2024-09-17T04:34:48.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.452+0000 7f5e69506640 1 --2- 172.21.15.43:0/3008497524 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5e50078bc0 0x7f5e5007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:48.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.453+0000 7f5e69506640 1 --2- 172.21.15.43:0/3008497524 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5e50078bc0 0x7f5e5007b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c033000 tx=0x7f5e5c038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:48.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.457+0000 7f5e61ffb640 1 -- 172.21.15.43:0/3008497524 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5e58063540 con 0x7f5e640cd880 2024-09-17T04:34:48.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.680+0000 7f5e6b76a640 1 -- 172.21.15.43:0/3008497524 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e6414a340 con 0x7f5e640cd880 2024-09-17T04:34:48.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.681+0000 7f5e61ffb640 1 -- 172.21.15.43:0/3008497524 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5542 (secure 0 0 0) 0x7f5e58067f70 con 0x7f5e640cd880 2024-09-17T04:34:48.681 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:34:48.681 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":3,"btime":"2024-09-17T04:34:47:027912+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/424910095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6835","nonce":424910095},{"type":"v1","addr":"172.21.15.62:6837","nonce":424910095}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6836/882111784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":882111784},{"type":"v1","addr":"172.21.15.62:6836","nonce":882111784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4431,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/47250523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":47250523},{"type":"v1","addr":"172.21.15.43:6834","nonce":47250523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4434,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3276393888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":3276393888},{"type":"v1","addr":"172.21.15.43:6835","nonce":3276393888}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3935895854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":3935895854},{"type":"v1","addr":"172.21.15.43:6837","nonce":3935895854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4455,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/3263944095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3263944095},{"type":"v1","addr":"172.21.15.62:6839","nonce":3263944095}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-17T04:34:48.681 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 3 2024-09-17T04:34:48.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.683+0000 7f5e6b76a640 1 -- 172.21.15.43:0/3008497524 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5e50078bc0 msgr2=0x7f5e5007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:48.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.683+0000 7f5e6b76a640 1 --2- 172.21.15.43:0/3008497524 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5e50078bc0 0x7f5e5007b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c033000 tx=0x7f5e5c038040 comp rx=0 tx=0).stop 2024-09-17T04:34:48.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.683+0000 7f5e6b76a640 1 -- 172.21.15.43:0/3008497524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e640cd880 msgr2=0x7f5e641e3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:48.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.683+0000 7f5e6b76a640 1 --2- 172.21.15.43:0/3008497524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e640cd880 0x7f5e641e3fc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5e58011ab0 tx=0x7f5e58011f70 comp rx=0 tx=0).stop 2024-09-17T04:34:48.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.683+0000 7f5e6b76a640 1 -- 172.21.15.43:0/3008497524 shutdown_connections 2024-09-17T04:34:48.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.683+0000 7f5e6b76a640 1 --2- 172.21.15.43:0/3008497524 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5e50078bc0 0x7f5e5007b0d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:48.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.683+0000 7f5e6b76a640 1 --2- 172.21.15.43:0/3008497524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e641468f0 0x7f5e64146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:48.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.683+0000 7f5e6b76a640 1 --2- 172.21.15.43:0/3008497524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e640cd880 0x7f5e641e3fc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:48.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.683+0000 7f5e6b76a640 1 --2- 172.21.15.43:0/3008497524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e4c003a00 0x7f5e640ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:48.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.683+0000 7f5e6b76a640 1 -- 172.21.15.43:0/3008497524 >> 172.21.15.43:0/3008497524 conn(0x7f5e640cefa0 msgr2=0x7f5e64148b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:48.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.683+0000 7f5e6b76a640 1 -- 172.21.15.43:0/3008497524 shutdown_connections 2024-09-17T04:34:48.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.683+0000 7f5e6b76a640 1 -- 172.21.15.43:0/3008497524 wait complete. 2024-09-17T04:34:48.694 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T04:34:48.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.811+0000 7f1c4c313640 1 -- 172.21.15.43:0/1526936231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c44155d40 msgr2=0x7f1c440d1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:48.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.811+0000 7f1c4c313640 1 --2- 172.21.15.43:0/1526936231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c44155d40 0x7f1c440d1ae0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1c38009830 tx=0x7f1c3802a510 comp rx=0 tx=0).stop 2024-09-17T04:34:48.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.811+0000 7f1c4c313640 1 -- 172.21.15.43:0/1526936231 shutdown_connections 2024-09-17T04:34:48.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.811+0000 7f1c4c313640 1 --2- 172.21.15.43:0/1526936231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c44155d40 0x7f1c440d1ae0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:48.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.811+0000 7f1c4c313640 1 --2- 172.21.15.43:0/1526936231 >> v2:172.21.15.62:3300/0 conn(0x7f1c440c6f00 0x7f1c440d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:48.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.811+0000 7f1c4c313640 1 -- 172.21.15.43:0/1526936231 >> 172.21.15.43:0/1526936231 conn(0x7f1c4406f460 msgr2=0x7f1c4406f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:48.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.811+0000 7f1c4c313640 1 -- 172.21.15.43:0/1526936231 shutdown_connections 2024-09-17T04:34:48.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.811+0000 7f1c4c313640 1 -- 172.21.15.43:0/1526936231 wait complete. 2024-09-17T04:34:48.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.813+0000 7f1c4c313640 1 Processor -- start 2024-09-17T04:34:48.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.813+0000 7f1c4c313640 1 -- start start 2024-09-17T04:34:48.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.814+0000 7f1c4c313640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c440c69b0 0x7f1c4414be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:48.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.814+0000 7f1c4c313640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c440c6f00 0x7f1c441597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:48.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.814+0000 7f1c4c313640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c44155d40 0x7f1c44159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:48.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.814+0000 7f1c4c313640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1c440c7730 con 0x7f1c44155d40 2024-09-17T04:34:48.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.814+0000 7f1c4c313640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1c440c7450 con 0x7f1c440c69b0 2024-09-17T04:34:48.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.814+0000 7f1c4c313640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1c440b4d50 con 0x7f1c440c6f00 2024-09-17T04:34:48.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.814+0000 7f1c4a8b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c44155d40 0x7f1c44159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:48.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.814+0000 7f1c4a8b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c44155d40 0x7f1c44159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47966/0 (socket says 172.21.15.43:47966) 2024-09-17T04:34:48.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.814+0000 7f1c4a8b0640 1 -- 172.21.15.43:0/2662818450 learned_addr learned my addr 172.21.15.43:0/2662818450 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:48.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.814+0000 7f1c4a0af640 1 --2- 172.21.15.43:0/2662818450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c440c69b0 0x7f1c4414be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:48.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.814+0000 7f1c498ae640 1 --2- 172.21.15.43:0/2662818450 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c440c6f00 0x7f1c441597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:48.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.815+0000 7f1c4a8b0640 1 -- 172.21.15.43:0/2662818450 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c440c6f00 msgr2=0x7f1c441597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:48.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.815+0000 7f1c4a8b0640 1 --2- 172.21.15.43:0/2662818450 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c440c6f00 0x7f1c441597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:48.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.815+0000 7f1c4a8b0640 1 -- 172.21.15.43:0/2662818450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c440c69b0 msgr2=0x7f1c4414be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:48.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.815+0000 7f1c4a8b0640 1 --2- 172.21.15.43:0/2662818450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c440c69b0 0x7f1c4414be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:48.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.815+0000 7f1c4a8b0640 1 -- 172.21.15.43:0/2662818450 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c44151b30 con 0x7f1c44155d40 2024-09-17T04:34:48.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.815+0000 7f1c498ae640 1 --2- 172.21.15.43:0/2662818450 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c440c6f00 0x7f1c441597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:34:48.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.815+0000 7f1c4a8b0640 1 --2- 172.21.15.43:0/2662818450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c44155d40 0x7f1c44159d00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400cb40 tx=0x7f1c3400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:48.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.815+0000 7f1c42ffd640 1 -- 172.21.15.43:0/2662818450 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c34016020 con 0x7f1c44155d40 2024-09-17T04:34:48.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.815+0000 7f1c42ffd640 1 -- 172.21.15.43:0/2662818450 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c3400acd0 con 0x7f1c44155d40 2024-09-17T04:34:48.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.815+0000 7f1c4c313640 1 -- 172.21.15.43:0/2662818450 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c44151e10 con 0x7f1c44155d40 2024-09-17T04:34:48.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.815+0000 7f1c42ffd640 1 -- 172.21.15.43:0/2662818450 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c34012680 con 0x7f1c44155d40 2024-09-17T04:34:48.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.815+0000 7f1c4c313640 1 -- 172.21.15.43:0/2662818450 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c441515d0 con 0x7f1c44155d40 2024-09-17T04:34:48.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.816+0000 7f1c4c313640 1 -- 172.21.15.43:0/2662818450 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c44150a80 con 0x7f1c44155d40 2024-09-17T04:34:48.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.817+0000 7f1c42ffd640 1 -- 172.21.15.43:0/2662818450 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1c34019020 con 0x7f1c44155d40 2024-09-17T04:34:48.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.817+0000 7f1c42ffd640 1 --2- 172.21.15.43:0/2662818450 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1c30078bc0 0x7f1c3007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:48.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.818+0000 7f1c42ffd640 1 -- 172.21.15.43:0/2662818450 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f1c3409ab90 con 0x7f1c44155d40 2024-09-17T04:34:48.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.818+0000 7f1c4a0af640 1 --2- 172.21.15.43:0/2662818450 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1c30078bc0 0x7f1c3007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:48.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.818+0000 7f1c4a0af640 1 --2- 172.21.15.43:0/2662818450 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1c30078bc0 0x7f1c3007b0d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c009b30 tx=0x7f1c3c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:48.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:48.822+0000 7f1c42ffd640 1 -- 172.21.15.43:0/2662818450 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1c34020030 con 0x7f1c44155d40 2024-09-17T04:34:49.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.009+0000 7f1c4c313640 1 -- 172.21.15.43:0/2662818450 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1c440cc640 con 0x7f1c44155d40 2024-09-17T04:34:49.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.009+0000 7f1c42ffd640 1 -- 172.21.15.43:0/2662818450 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f1c34063320 con 0x7f1c44155d40 2024-09-17T04:34:49.009 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:34:49.009 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2024-09-17T04:34:49.009 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:34:49.010 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2024-09-17T04:34:49.010 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2024-09-17T04:34:49.010 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:34:49.010 INFO:teuthology.orchestra.run.smithi043.stdout:] 2024-09-17T04:34:49.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.011+0000 7f1c4c313640 1 -- 172.21.15.43:0/2662818450 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1c30078bc0 msgr2=0x7f1c3007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:49.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.011+0000 7f1c4c313640 1 --2- 172.21.15.43:0/2662818450 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1c30078bc0 0x7f1c3007b0d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c009b30 tx=0x7f1c3c005f90 comp rx=0 tx=0).stop 2024-09-17T04:34:49.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.011+0000 7f1c4c313640 1 -- 172.21.15.43:0/2662818450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c44155d40 msgr2=0x7f1c44159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:49.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.011+0000 7f1c4c313640 1 --2- 172.21.15.43:0/2662818450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c44155d40 0x7f1c44159d00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400cb40 tx=0x7f1c3400a060 comp rx=0 tx=0).stop 2024-09-17T04:34:49.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.011+0000 7f1c4c313640 1 -- 172.21.15.43:0/2662818450 shutdown_connections 2024-09-17T04:34:49.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.011+0000 7f1c4c313640 1 --2- 172.21.15.43:0/2662818450 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1c30078bc0 0x7f1c3007b0d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:49.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.011+0000 7f1c4c313640 1 --2- 172.21.15.43:0/2662818450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c44155d40 0x7f1c44159d00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:49.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.011+0000 7f1c4c313640 1 --2- 172.21.15.43:0/2662818450 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c440c6f00 0x7f1c441597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:49.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.011+0000 7f1c4c313640 1 --2- 172.21.15.43:0/2662818450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c440c69b0 0x7f1c4414be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:49.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.011+0000 7f1c4c313640 1 -- 172.21.15.43:0/2662818450 >> 172.21.15.43:0/2662818450 conn(0x7f1c4406f460 msgr2=0x7f1c4415f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:49.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.011+0000 7f1c4c313640 1 -- 172.21.15.43:0/2662818450 shutdown_connections 2024-09-17T04:34:49.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.011+0000 7f1c4c313640 1 -- 172.21.15.43:0/2662818450 wait complete. 2024-09-17T04:34:49.022 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T04:34:49.023 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T04:34:49.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.143+0000 7fc5397b6640 1 -- 172.21.15.43:0/3952290333 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5340c7ed0 msgr2=0x7fc5341673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:49.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.143+0000 7fc5397b6640 1 --2- 172.21.15.43:0/3952290333 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5340c7ed0 0x7fc5341673e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc52c009860 tx=0x7fc52c02a5c0 comp rx=0 tx=0).stop 2024-09-17T04:34:49.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.143+0000 7fc5397b6640 1 -- 172.21.15.43:0/3952290333 shutdown_connections 2024-09-17T04:34:49.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.143+0000 7fc5397b6640 1 --2- 172.21.15.43:0/3952290333 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5340c7ed0 0x7fc5341673e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:49.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.143+0000 7fc5397b6640 1 -- 172.21.15.43:0/3952290333 >> 172.21.15.43:0/3952290333 conn(0x7fc5340690f0 msgr2=0x7fc534069500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:49.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.143+0000 7fc5397b6640 1 -- 172.21.15.43:0/3952290333 shutdown_connections 2024-09-17T04:34:49.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.143+0000 7fc5397b6640 1 -- 172.21.15.43:0/3952290333 wait complete. 2024-09-17T04:34:49.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.145+0000 7fc5397b6640 1 Processor -- start 2024-09-17T04:34:49.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.145+0000 7fc5397b6640 1 -- start start 2024-09-17T04:34:49.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc5397b6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5340c6090 0x7fc5340caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:49.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc5397b6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5340c7ed0 0x7fc534153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:49.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc5397b6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc53415c620 0x7fc53414cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:49.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc5397b6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc5340c6c00 con 0x7fc5340c7ed0 2024-09-17T04:34:49.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc5397b6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc5340b5240 con 0x7fc5340c6090 2024-09-17T04:34:49.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc5397b6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc5340c6ee0 con 0x7fc53415c620 2024-09-17T04:34:49.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc5327fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5340c7ed0 0x7fc534153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:49.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc5327fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5340c7ed0 0x7fc534153840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47972/0 (socket says 172.21.15.43:47972) 2024-09-17T04:34:49.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc5327fc640 1 -- 172.21.15.43:0/1794351380 learned_addr learned my addr 172.21.15.43:0/1794351380 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:49.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc532ffd640 1 --2- 172.21.15.43:0/1794351380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5340c6090 0x7fc5340caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:49.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc5337fe640 1 --2- 172.21.15.43:0/1794351380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc53415c620 0x7fc53414cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:49.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc5327fc640 1 -- 172.21.15.43:0/1794351380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc53415c620 msgr2=0x7fc53414cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:49.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc5327fc640 1 --2- 172.21.15.43:0/1794351380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc53415c620 0x7fc53414cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:49.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc5327fc640 1 -- 172.21.15.43:0/1794351380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5340c6090 msgr2=0x7fc5340caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:49.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc5327fc640 1 --2- 172.21.15.43:0/1794351380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5340c6090 0x7fc5340caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:49.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc5327fc640 1 -- 172.21.15.43:0/1794351380 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc534152d30 con 0x7fc5340c7ed0 2024-09-17T04:34:49.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc5327fc640 1 --2- 172.21.15.43:0/1794351380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5340c7ed0 0x7fc534153840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00c390 tx=0x7fc51c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:49.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc52b7fe640 1 -- 172.21.15.43:0/1794351380 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51c017070 con 0x7fc5340c7ed0 2024-09-17T04:34:49.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc52b7fe640 1 -- 172.21.15.43:0/1794351380 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc51c0053c0 con 0x7fc5340c7ed0 2024-09-17T04:34:49.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc5397b6640 1 -- 172.21.15.43:0/1794351380 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc53414ab90 con 0x7fc5340c7ed0 2024-09-17T04:34:49.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.147+0000 7fc52b7fe640 1 -- 172.21.15.43:0/1794351380 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51c003850 con 0x7fc5340c7ed0 2024-09-17T04:34:49.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.148+0000 7fc5397b6640 1 -- 172.21.15.43:0/1794351380 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc534151050 con 0x7fc5340c7ed0 2024-09-17T04:34:49.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.149+0000 7fc5397b6640 1 -- 172.21.15.43:0/1794351380 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc534156000 con 0x7fc5340c7ed0 2024-09-17T04:34:49.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.149+0000 7fc52b7fe640 1 -- 172.21.15.43:0/1794351380 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc51c01a070 con 0x7fc5340c7ed0 2024-09-17T04:34:49.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.150+0000 7fc52b7fe640 1 --2- 172.21.15.43:0/1794351380 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc514078b90 0x7fc51407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:49.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.150+0000 7fc52b7fe640 1 -- 172.21.15.43:0/1794351380 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fc51c099c50 con 0x7fc5340c7ed0 2024-09-17T04:34:49.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.150+0000 7fc532ffd640 1 --2- 172.21.15.43:0/1794351380 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc514078b90 0x7fc51407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:49.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.150+0000 7fc532ffd640 1 --2- 172.21.15.43:0/1794351380 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc514078b90 0x7fc51407b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc524001be0 tx=0x7fc524001a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:49.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.154+0000 7fc52b7fe640 1 -- 172.21.15.43:0/1794351380 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc51c061e10 con 0x7fc5340c7ed0 2024-09-17T04:34:49.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:49.337+0000 7fc5397b6640 1 -- 172.21.15.43:0/1794351380 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc5340b71f0 con 0x7fc5340c7ed0 2024-09-17T04:34:49.395 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:34:49.397 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:34:50.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.045+0000 7fc52b7fe640 1 -- 172.21.15.43:0/1794351380 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7fc51c066840 con 0x7fc5340c7ed0 2024-09-17T04:34:50.045 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2024-09-17T04:34:50.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.049+0000 7fc5397b6640 1 -- 172.21.15.43:0/1794351380 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc514078b90 msgr2=0x7fc51407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:50.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.049+0000 7fc5397b6640 1 --2- 172.21.15.43:0/1794351380 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc514078b90 0x7fc51407b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc524001be0 tx=0x7fc524001a50 comp rx=0 tx=0).stop 2024-09-17T04:34:50.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.049+0000 7fc5397b6640 1 -- 172.21.15.43:0/1794351380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5340c7ed0 msgr2=0x7fc534153840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:50.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.049+0000 7fc5397b6640 1 --2- 172.21.15.43:0/1794351380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5340c7ed0 0x7fc534153840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00c390 tx=0x7fc51c00c850 comp rx=0 tx=0).stop 2024-09-17T04:34:50.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.049+0000 7fc5397b6640 1 -- 172.21.15.43:0/1794351380 shutdown_connections 2024-09-17T04:34:50.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.049+0000 7fc5397b6640 1 --2- 172.21.15.43:0/1794351380 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc514078b90 0x7fc51407b0a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:50.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.049+0000 7fc5397b6640 1 --2- 172.21.15.43:0/1794351380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc53415c620 0x7fc53414cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:50.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.049+0000 7fc5397b6640 1 --2- 172.21.15.43:0/1794351380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5340c7ed0 0x7fc534153840 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:50.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.049+0000 7fc5397b6640 1 --2- 172.21.15.43:0/1794351380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5340c6090 0x7fc5340caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:50.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.049+0000 7fc5397b6640 1 -- 172.21.15.43:0/1794351380 >> 172.21.15.43:0/1794351380 conn(0x7fc5340690f0 msgr2=0x7fc53414de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:50.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.049+0000 7fc5397b6640 1 -- 172.21.15.43:0/1794351380 shutdown_connections 2024-09-17T04:34:50.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.049+0000 7fc5397b6640 1 -- 172.21.15.43:0/1794351380 wait complete. 2024-09-17T04:34:50.067 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T04:34:50.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.197+0000 7f80266b2640 1 -- 172.21.15.43:0/191057195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8008004d40 msgr2=0x7f80080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:50.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.197+0000 7f80266b2640 1 --2- 172.21.15.43:0/191057195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8008004d40 0x7f80080051d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8018001e10 tx=0x7f8008005830 comp rx=0 tx=0).stop 2024-09-17T04:34:50.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.197+0000 7f8024c4f640 1 -- 172.21.15.43:0/191057195 reap_dead start 2024-09-17T04:34:50.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.198+0000 7f80266b2640 1 -- 172.21.15.43:0/191057195 shutdown_connections 2024-09-17T04:34:50.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.198+0000 7f80266b2640 1 -- 172.21.15.43:0/191057195 >> 172.21.15.43:0/191057195 conn(0x7f802006d1a0 msgr2=0x7f802006d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:50.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.198+0000 7f80266b2640 1 -- 172.21.15.43:0/191057195 shutdown_connections 2024-09-17T04:34:50.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.198+0000 7f80266b2640 1 -- 172.21.15.43:0/191057195 wait complete. 2024-09-17T04:34:50.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.199+0000 7f80266b2640 1 Processor -- start 2024-09-17T04:34:50.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.200+0000 7f80266b2640 1 -- start start 2024-09-17T04:34:50.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.201+0000 7f80266b2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8008004d40 0x7f80201df2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:50.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.201+0000 7f80266b2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8020153020 0x7f802014cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:50.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.201+0000 7f80266b2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8020148ab0 0x7f8020148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:50.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.201+0000 7f80266b2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8020072f00 con 0x7f8020153020 2024-09-17T04:34:50.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.201+0000 7f80266b2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8020073b70 con 0x7f8008004d40 2024-09-17T04:34:50.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.201+0000 7f80266b2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f80201539f0 con 0x7f8020148ab0 2024-09-17T04:34:50.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.201+0000 7f801f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8020153020 0x7f802014cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:50.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.201+0000 7f801f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8020153020 0x7f802014cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41472/0 (socket says 172.21.15.43:41472) 2024-09-17T04:34:50.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.201+0000 7f801f7fe640 1 -- 172.21.15.43:0/1256721169 learned_addr learned my addr 172.21.15.43:0/1256721169 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:50.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.201+0000 7f801ffff640 1 --2- 172.21.15.43:0/1256721169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8008004d40 0x7f80201df2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:50.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.201+0000 7f8024c4f640 1 --2- 172.21.15.43:0/1256721169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8020148ab0 0x7f8020148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:50.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.201+0000 7f801f7fe640 1 -- 172.21.15.43:0/1256721169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8020148ab0 msgr2=0x7f8020148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:50.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.201+0000 7f801f7fe640 1 --2- 172.21.15.43:0/1256721169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8020148ab0 0x7f8020148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:50.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.201+0000 7f801f7fe640 1 -- 172.21.15.43:0/1256721169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8008004d40 msgr2=0x7f80201df2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:50.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.201+0000 7f801f7fe640 1 --2- 172.21.15.43:0/1256721169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8008004d40 0x7f80201df2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:50.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.201+0000 7f801f7fe640 1 -- 172.21.15.43:0/1256721169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80201eecb0 con 0x7f8020153020 2024-09-17T04:34:50.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.201+0000 7f801f7fe640 1 --2- 172.21.15.43:0/1256721169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8020153020 0x7f802014cbd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8014001ac0 tx=0x7f8014003c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:50.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.202+0000 7f801cff9640 1 -- 172.21.15.43:0/1256721169 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8014011950 con 0x7f8020153020 2024-09-17T04:34:50.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.202+0000 7f801cff9640 1 -- 172.21.15.43:0/1256721169 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8014018020 con 0x7f8020153020 2024-09-17T04:34:50.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.202+0000 7f80266b2640 1 -- 172.21.15.43:0/1256721169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80201eef90 con 0x7f8020153020 2024-09-17T04:34:50.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.202+0000 7f801cff9640 1 -- 172.21.15.43:0/1256721169 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8014011d70 con 0x7f8020153020 2024-09-17T04:34:50.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.202+0000 7f80266b2640 1 -- 172.21.15.43:0/1256721169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80201ef550 con 0x7f8020153020 2024-09-17T04:34:50.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.203+0000 7f80266b2640 1 -- 172.21.15.43:0/1256721169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8020159860 con 0x7f8020153020 2024-09-17T04:34:50.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.204+0000 7f801cff9640 1 -- 172.21.15.43:0/1256721169 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8014013450 con 0x7f8020153020 2024-09-17T04:34:50.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.204+0000 7f801cff9640 1 --2- 172.21.15.43:0/1256721169 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f800c078b90 0x7f800c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:50.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.204+0000 7f801cff9640 1 -- 172.21.15.43:0/1256721169 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f801409dda0 con 0x7f8020153020 2024-09-17T04:34:50.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.204+0000 7f801ffff640 1 --2- 172.21.15.43:0/1256721169 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f800c078b90 0x7f800c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:50.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.205+0000 7f801ffff640 1 --2- 172.21.15.43:0/1256721169 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f800c078b90 0x7f800c07b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8010009c50 tx=0x7f8010005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:50.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.209+0000 7f801cff9640 1 -- 172.21.15.43:0/1256721169 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8020159860 con 0x7f8020153020 2024-09-17T04:34:50.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:50.397+0000 7f80266b2640 1 -- 172.21.15.43:0/1256721169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8020149e90 con 0x7f8020153020 2024-09-17T04:34:51.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.051+0000 7f801cff9640 1 -- 172.21.15.43:0/1256721169 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) ==== 170+0+0 (secure 0 0 0) 0x7f8014022020 con 0x7f8020153020 2024-09-17T04:34:51.051 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2024-09-17T04:34:51.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.055+0000 7f80266b2640 1 -- 172.21.15.43:0/1256721169 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f800c078b90 msgr2=0x7f800c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:51.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.055+0000 7f80266b2640 1 --2- 172.21.15.43:0/1256721169 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f800c078b90 0x7f800c07b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8010009c50 tx=0x7f8010005f90 comp rx=0 tx=0).stop 2024-09-17T04:34:51.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.055+0000 7f80266b2640 1 -- 172.21.15.43:0/1256721169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8020153020 msgr2=0x7f802014cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:51.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.056+0000 7f80266b2640 1 --2- 172.21.15.43:0/1256721169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8020153020 0x7f802014cbd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8014001ac0 tx=0x7f8014003c70 comp rx=0 tx=0).stop 2024-09-17T04:34:51.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.057+0000 7f80266b2640 1 -- 172.21.15.43:0/1256721169 shutdown_connections 2024-09-17T04:34:51.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.057+0000 7f80266b2640 1 --2- 172.21.15.43:0/1256721169 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f800c078b90 0x7f800c07b0a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:51.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.057+0000 7f80266b2640 1 --2- 172.21.15.43:0/1256721169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8020148ab0 0x7f8020148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:51.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.057+0000 7f80266b2640 1 --2- 172.21.15.43:0/1256721169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8020153020 0x7f802014cbd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:51.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.057+0000 7f80266b2640 1 --2- 172.21.15.43:0/1256721169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8008004d40 0x7f80201df2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:51.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.057+0000 7f80266b2640 1 -- 172.21.15.43:0/1256721169 >> 172.21.15.43:0/1256721169 conn(0x7f802006d1a0 msgr2=0x7f802014f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:51.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.058+0000 7f80266b2640 1 -- 172.21.15.43:0/1256721169 shutdown_connections 2024-09-17T04:34:51.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.060+0000 7f80266b2640 1 -- 172.21.15.43:0/1256721169 wait complete. 2024-09-17T04:34:51.086 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T04:34:51.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.210+0000 7fc6f5ff9640 1 -- 172.21.15.43:0/1592885190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6f00cd570 msgr2=0x7fc6f00cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:51.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.210+0000 7fc6f5ff9640 1 --2- 172.21.15.43:0/1592885190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6f00cd570 0x7fc6f00cd980 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4005fd0 tx=0x7fc6e402a5d0 comp rx=0 tx=0).stop 2024-09-17T04:34:51.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.210+0000 7fc6f5ff9640 1 -- 172.21.15.43:0/1592885190 shutdown_connections 2024-09-17T04:34:51.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.210+0000 7fc6f5ff9640 1 --2- 172.21.15.43:0/1592885190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6f00cd570 0x7fc6f00cd980 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:51.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.210+0000 7fc6f5ff9640 1 --2- 172.21.15.43:0/1592885190 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6f00cbef0 0x7fc6f00b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:51.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.210+0000 7fc6f5ff9640 1 -- 172.21.15.43:0/1592885190 >> 172.21.15.43:0/1592885190 conn(0x7fc6f006d9f0 msgr2=0x7fc6f006ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:51.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.210+0000 7fc6f5ff9640 1 -- 172.21.15.43:0/1592885190 shutdown_connections 2024-09-17T04:34:51.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.210+0000 7fc6f5ff9640 1 -- 172.21.15.43:0/1592885190 wait complete. 2024-09-17T04:34:51.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.212+0000 7fc6f5ff9640 1 Processor -- start 2024-09-17T04:34:51.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.212+0000 7fc6f5ff9640 1 -- start start 2024-09-17T04:34:51.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.213+0000 7fc6f5ff9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f0068d00 0x7fc6f01f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:51.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.213+0000 7fc6f5ff9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6f00cbef0 0x7fc6f014ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:51.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.213+0000 7fc6f5ff9640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6f00cd570 0x7fc6f01e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:51.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.213+0000 7fc6f5ff9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f00ccb60 con 0x7fc6f00cbef0 2024-09-17T04:34:51.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.213+0000 7fc6f5ff9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f00cc880 con 0x7fc6f0068d00 2024-09-17T04:34:51.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.213+0000 7fc6f5ff9640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f00cbc80 con 0x7fc6f00cd570 2024-09-17T04:34:51.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.213+0000 7fc6eeffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6f00cbef0 0x7fc6f014ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:51.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.213+0000 7fc6eeffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6f00cbef0 0x7fc6f014ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41484/0 (socket says 172.21.15.43:41484) 2024-09-17T04:34:51.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.213+0000 7fc6eeffd640 1 -- 172.21.15.43:0/4283059196 learned_addr learned my addr 172.21.15.43:0/4283059196 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:51.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.213+0000 7fc6ef7fe640 1 --2- 172.21.15.43:0/4283059196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f0068d00 0x7fc6f01f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:51.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.213+0000 7fc6effff640 1 --2- 172.21.15.43:0/4283059196 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6f00cd570 0x7fc6f01e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:51.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.214+0000 7fc6eeffd640 1 -- 172.21.15.43:0/4283059196 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6f00cd570 msgr2=0x7fc6f01e6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:51.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.214+0000 7fc6eeffd640 1 --2- 172.21.15.43:0/4283059196 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6f00cd570 0x7fc6f01e6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:51.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.214+0000 7fc6eeffd640 1 -- 172.21.15.43:0/4283059196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f0068d00 msgr2=0x7fc6f01f53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:51.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.214+0000 7fc6eeffd640 1 --2- 172.21.15.43:0/4283059196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f0068d00 0x7fc6f01f53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:51.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.214+0000 7fc6eeffd640 1 -- 172.21.15.43:0/4283059196 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f00cf2d0 con 0x7fc6f00cbef0 2024-09-17T04:34:51.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.214+0000 7fc6eeffd640 1 --2- 172.21.15.43:0/4283059196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6f00cbef0 0x7fc6f014ad40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4000c00 tx=0x7fc6e40035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:51.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.214+0000 7fc6d7fff640 1 -- 172.21.15.43:0/4283059196 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e403e030 con 0x7fc6f00cbef0 2024-09-17T04:34:51.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.214+0000 7fc6d7fff640 1 -- 172.21.15.43:0/4283059196 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6e4003ae0 con 0x7fc6f00cbef0 2024-09-17T04:34:51.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.214+0000 7fc6d7fff640 1 -- 172.21.15.43:0/4283059196 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4035040 con 0x7fc6f00cbef0 2024-09-17T04:34:51.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.214+0000 7fc6f5ff9640 1 -- 172.21.15.43:0/4283059196 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f00cfd90 con 0x7fc6f00cbef0 2024-09-17T04:34:51.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.214+0000 7fc6f5ff9640 1 -- 172.21.15.43:0/4283059196 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f01f59a0 con 0x7fc6f00cbef0 2024-09-17T04:34:51.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.215+0000 7fc6f5ff9640 1 -- 172.21.15.43:0/4283059196 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f00b4580 con 0x7fc6f00cbef0 2024-09-17T04:34:51.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.216+0000 7fc6d7fff640 1 -- 172.21.15.43:0/4283059196 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6e4041030 con 0x7fc6f00cbef0 2024-09-17T04:34:51.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.216+0000 7fc6d7fff640 1 --2- 172.21.15.43:0/4283059196 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc6dc078bc0 0x7fc6dc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:51.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.216+0000 7fc6d7fff640 1 -- 172.21.15.43:0/4283059196 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7fc6e40bb1e0 con 0x7fc6f00cbef0 2024-09-17T04:34:51.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.217+0000 7fc6ef7fe640 1 --2- 172.21.15.43:0/4283059196 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc6dc078bc0 0x7fc6dc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:51.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.217+0000 7fc6ef7fe640 1 --2- 172.21.15.43:0/4283059196 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc6dc078bc0 0x7fc6dc07b0d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009bb0 tx=0x7fc6e0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:51.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.221+0000 7fc6d7fff640 1 -- 172.21.15.43:0/4283059196 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc6f00b4580 con 0x7fc6f00cbef0 2024-09-17T04:34:51.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:51.442+0000 7fc6f5ff9640 1 -- 172.21.15.43:0/4283059196 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc6f0155fe0 con 0x7fc6f00cbef0 2024-09-17T04:34:52.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.053+0000 7fc6d7fff640 1 -- 172.21.15.43:0/4283059196 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fc6e4082f90 con 0x7fc6f00cbef0 2024-09-17T04:34:52.053 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 2 and data pool 3 2024-09-17T04:34:52.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.057+0000 7fc6f5ff9640 1 -- 172.21.15.43:0/4283059196 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc6dc078bc0 msgr2=0x7fc6dc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:52.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.057+0000 7fc6f5ff9640 1 --2- 172.21.15.43:0/4283059196 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc6dc078bc0 0x7fc6dc07b0d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009bb0 tx=0x7fc6e0005f90 comp rx=0 tx=0).stop 2024-09-17T04:34:52.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.057+0000 7fc6f5ff9640 1 -- 172.21.15.43:0/4283059196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6f00cbef0 msgr2=0x7fc6f014ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:52.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.057+0000 7fc6f5ff9640 1 --2- 172.21.15.43:0/4283059196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6f00cbef0 0x7fc6f014ad40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4000c00 tx=0x7fc6e40035f0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.057+0000 7fc6f5ff9640 1 -- 172.21.15.43:0/4283059196 shutdown_connections 2024-09-17T04:34:52.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.057+0000 7fc6f5ff9640 1 --2- 172.21.15.43:0/4283059196 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc6dc078bc0 0x7fc6dc07b0d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.057+0000 7fc6f5ff9640 1 --2- 172.21.15.43:0/4283059196 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6f00cd570 0x7fc6f01e6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.057+0000 7fc6f5ff9640 1 --2- 172.21.15.43:0/4283059196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6f00cbef0 0x7fc6f014ad40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.057+0000 7fc6f5ff9640 1 --2- 172.21.15.43:0/4283059196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f0068d00 0x7fc6f01f53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.057+0000 7fc6f5ff9640 1 -- 172.21.15.43:0/4283059196 >> 172.21.15.43:0/4283059196 conn(0x7fc6f006d9f0 msgr2=0x7fc6f00c7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:52.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.057+0000 7fc6f5ff9640 1 -- 172.21.15.43:0/4283059196 shutdown_connections 2024-09-17T04:34:52.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.057+0000 7fc6f5ff9640 1 -- 172.21.15.43:0/4283059196 wait complete. 2024-09-17T04:34:52.085 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:34:52.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.207+0000 7f39c3b3a640 1 -- 172.21.15.43:0/3495773125 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39bc0c69b0 msgr2=0x7f39bc1672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:52.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.207+0000 7f39c3b3a640 1 --2- 172.21.15.43:0/3495773125 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39bc0c69b0 0x7f39bc1672e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009860 tx=0x7f39b402a530 comp rx=0 tx=0).stop 2024-09-17T04:34:52.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.207+0000 7f39c3b3a640 1 -- 172.21.15.43:0/3495773125 shutdown_connections 2024-09-17T04:34:52.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.207+0000 7f39c3b3a640 1 --2- 172.21.15.43:0/3495773125 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39bc0c69b0 0x7f39bc1672e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.207+0000 7f39c3b3a640 1 -- 172.21.15.43:0/3495773125 >> 172.21.15.43:0/3495773125 conn(0x7f39bc06f460 msgr2=0x7f39bc06f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:52.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.207+0000 7f39c3b3a640 1 -- 172.21.15.43:0/3495773125 shutdown_connections 2024-09-17T04:34:52.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.207+0000 7f39c3b3a640 1 -- 172.21.15.43:0/3495773125 wait complete. 2024-09-17T04:34:52.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.209+0000 7f39c3b3a640 1 Processor -- start 2024-09-17T04:34:52.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.209+0000 7f39c3b3a640 1 -- start start 2024-09-17T04:34:52.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.210+0000 7f39c3b3a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39bc0c69b0 0x7f39bc0c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:52.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.210+0000 7f39c3b3a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39bc0c6f00 0x7f39bc1f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:52.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.210+0000 7f39c3b3a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39bc155d40 0x7f39bc14be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:52.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.210+0000 7f39c3b3a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc0c7730 con 0x7f39bc0c69b0 2024-09-17T04:34:52.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.210+0000 7f39c3b3a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc0c7aa0 con 0x7f39bc0c6f00 2024-09-17T04:34:52.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.210+0000 7f39c3b3a640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f39bc0b4d50 con 0x7f39bc155d40 2024-09-17T04:34:52.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.210+0000 7f39c18d6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39bc0c69b0 0x7f39bc0c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.210+0000 7f39c18d6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39bc0c69b0 0x7f39bc0c9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41488/0 (socket says 172.21.15.43:41488) 2024-09-17T04:34:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.210+0000 7f39c18d6640 1 -- 172.21.15.43:0/2463434136 learned_addr learned my addr 172.21.15.43:0/2463434136 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.210+0000 7f39c20d7640 1 --2- 172.21.15.43:0/2463434136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39bc155d40 0x7f39bc14be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.210+0000 7f39c10d5640 1 --2- 172.21.15.43:0/2463434136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39bc0c6f00 0x7f39bc1f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.210+0000 7f39c18d6640 1 -- 172.21.15.43:0/2463434136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39bc155d40 msgr2=0x7f39bc14be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.210+0000 7f39c18d6640 1 --2- 172.21.15.43:0/2463434136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39bc155d40 0x7f39bc14be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.210+0000 7f39c18d6640 1 -- 172.21.15.43:0/2463434136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39bc0c6f00 msgr2=0x7f39bc1f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.210+0000 7f39c18d6640 1 --2- 172.21.15.43:0/2463434136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39bc0c6f00 0x7f39bc1f52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.210+0000 7f39c18d6640 1 -- 172.21.15.43:0/2463434136 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39bc1f5800 con 0x7f39bc0c69b0 2024-09-17T04:34:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.210+0000 7f39c10d5640 1 --2- 172.21.15.43:0/2463434136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39bc0c6f00 0x7f39bc1f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:34:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.211+0000 7f39c18d6640 1 --2- 172.21.15.43:0/2463434136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39bc0c69b0 0x7f39bc0c9ff0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00c730 tx=0x7f39ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.211+0000 7f39ba7fc640 1 -- 172.21.15.43:0/2463434136 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac003b70 con 0x7f39bc0c69b0 2024-09-17T04:34:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.211+0000 7f39ba7fc640 1 -- 172.21.15.43:0/2463434136 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39ac003d30 con 0x7f39bc0c69b0 2024-09-17T04:34:52.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.211+0000 7f39c3b3a640 1 -- 172.21.15.43:0/2463434136 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39bc15cd40 con 0x7f39bc0c69b0 2024-09-17T04:34:52.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.211+0000 7f39ba7fc640 1 -- 172.21.15.43:0/2463434136 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac00aab0 con 0x7f39bc0c69b0 2024-09-17T04:34:52.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.211+0000 7f39c3b3a640 1 -- 172.21.15.43:0/2463434136 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39bc15d300 con 0x7f39bc0c69b0 2024-09-17T04:34:52.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.212+0000 7f39c3b3a640 1 -- 172.21.15.43:0/2463434136 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39bc0b5ca0 con 0x7f39bc0c69b0 2024-09-17T04:34:52.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.213+0000 7f39ba7fc640 1 -- 172.21.15.43:0/2463434136 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f39ac00ac50 con 0x7f39bc0c69b0 2024-09-17T04:34:52.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.213+0000 7f39ba7fc640 1 --2- 172.21.15.43:0/2463434136 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f39a8078b90 0x7f39a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:52.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.214+0000 7f39ba7fc640 1 -- 172.21.15.43:0/2463434136 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f39ac09aa60 con 0x7f39bc0c69b0 2024-09-17T04:34:52.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.214+0000 7f39c10d5640 1 --2- 172.21.15.43:0/2463434136 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f39a8078b90 0x7f39a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:52.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.214+0000 7f39c10d5640 1 --2- 172.21.15.43:0/2463434136 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f39a8078b90 0x7f39a807b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f39b0000c00 tx=0x7f39b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:52.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.218+0000 7f39ba7fc640 1 -- 172.21.15.43:0/2463434136 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f39bc0b5ca0 con 0x7f39bc0c69b0 2024-09-17T04:34:52.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.404+0000 7f39c3b3a640 1 -- 172.21.15.43:0/2463434136 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39bc0d1d90 con 0x7f39bc0c69b0 2024-09-17T04:34:52.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.405+0000 7f39ba7fc640 1 -- 172.21.15.43:0/2463434136 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16654 (secure 0 0 0) 0x7f39ac062fc0 con 0x7f39bc0c69b0 2024-09-17T04:34:52.405 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:34:52.405 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","created":"2024-09-17T04:34:26.485007+0000","modified":"2024-09-17T04:34:51.443588+0000","last_up_change":"2024-09-17T04:34:40.712497+0000","last_in_change":"2024-09-17T04:34:30.384271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:34:38.905735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:34:49.341236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:34:50.401489+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eaab925a-60b4-429f-aee1-50de6f32358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6817","nonce":1685480205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6819","nonce":1685480205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6823","nonce":1685480205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6821","nonce":1685480205}]},"public_addr":"172.21.15.43:6817/1685480205","cluster_addr":"172.21.15.43:6819/1685480205","heartbeat_back_addr":"172.21.15.43:6823/1685480205","heartbeat_front_addr":"172.21.15.43:6821/1685480205","state":["exists","up"]},{"osd":1,"uuid":"2c0e64be-db05-45db-aad8-2f2f42812100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6825","nonce":1564354446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6827","nonce":1564354446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6831","nonce":1564354446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6829","nonce":1564354446}]},"public_addr":"172.21.15.43:6825/1564354446","cluster_addr":"172.21.15.43:6827/1564354446","heartbeat_back_addr":"172.21.15.43:6831/1564354446","heartbeat_front_addr":"172.21.15.43:6829/1564354446","state":["exists","up"]},{"osd":2,"uuid":"fa88665d-2acb-4e44-99ac-1d496adf5b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6801","nonce":1385342605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6803","nonce":1385342605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6807","nonce":1385342605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6805","nonce":1385342605}]},"public_addr":"172.21.15.43:6801/1385342605","cluster_addr":"172.21.15.43:6803/1385342605","heartbeat_back_addr":"172.21.15.43:6807/1385342605","heartbeat_front_addr":"172.21.15.43:6805/1385342605","state":["exists","up"]},{"osd":3,"uuid":"710a28f0-d04a-4b4a-bba3-28f7c7b1eb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6809","nonce":1646004903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6811","nonce":1646004903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6815","nonce":1646004903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6813","nonce":1646004903}]},"public_addr":"172.21.15.43:6809/1646004903","cluster_addr":"172.21.15.43:6811/1646004903","heartbeat_back_addr":"172.21.15.43:6815/1646004903","heartbeat_front_addr":"172.21.15.43:6813/1646004903","state":["exists","up"]},{"osd":4,"uuid":"d2eca96b-1917-4dbb-b6e3-f4410bbc5c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6803","nonce":3991694106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6805","nonce":3991694106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6809","nonce":3991694106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6807","nonce":3991694106}]},"public_addr":"172.21.15.62:6803/3991694106","cluster_addr":"172.21.15.62:6805/3991694106","heartbeat_back_addr":"172.21.15.62:6809/3991694106","heartbeat_front_addr":"172.21.15.62:6807/3991694106","state":["exists","up"]},{"osd":5,"uuid":"ae843bea-38ff-4ca6-a7a9-6e58c7a17fd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6827","nonce":2558615114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6829","nonce":2558615114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6833","nonce":2558615114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6831","nonce":2558615114}]},"public_addr":"172.21.15.62:6827/2558615114","cluster_addr":"172.21.15.62:6829/2558615114","heartbeat_back_addr":"172.21.15.62:6833/2558615114","heartbeat_front_addr":"172.21.15.62:6831/2558615114","state":["exists","up"]},{"osd":6,"uuid":"44c53356-010d-443f-9e8d-f0d5da106893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6811","nonce":1901653154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6813","nonce":1901653154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6817","nonce":1901653154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6815","nonce":1901653154}]},"public_addr":"172.21.15.62:6811/1901653154","cluster_addr":"172.21.15.62:6813/1901653154","heartbeat_back_addr":"172.21.15.62:6817/1901653154","heartbeat_front_addr":"172.21.15.62:6815/1901653154","state":["exists","up"]},{"osd":7,"uuid":"c8960d11-dd10-4e36-b9d8-f1fdc0abe9c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6819","nonce":2974376041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6821","nonce":2974376041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6825","nonce":2974376041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6823","nonce":2974376041}]},"public_addr":"172.21.15.62:6819/2974376041","cluster_addr":"172.21.15.62:6821/2974376041","heartbeat_back_addr":"172.21.15.62:6825/2974376041","heartbeat_front_addr":"172.21.15.62:6823/2974376041","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.435063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.372079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:35.973575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.690029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.944690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.691776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.877497+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.689786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:34:52.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.407+0000 7f39c3b3a640 1 -- 172.21.15.43:0/2463434136 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f39a8078b90 msgr2=0x7f39a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:52.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.407+0000 7f39c3b3a640 1 --2- 172.21.15.43:0/2463434136 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f39a8078b90 0x7f39a807b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f39b0000c00 tx=0x7f39b0009040 comp rx=0 tx=0).stop 2024-09-17T04:34:52.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.408+0000 7f39c3b3a640 1 -- 172.21.15.43:0/2463434136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39bc0c69b0 msgr2=0x7f39bc0c9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:52.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.408+0000 7f39c3b3a640 1 --2- 172.21.15.43:0/2463434136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39bc0c69b0 0x7f39bc0c9ff0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00c730 tx=0x7f39ac00cbf0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.408+0000 7f39c3b3a640 1 -- 172.21.15.43:0/2463434136 shutdown_connections 2024-09-17T04:34:52.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.408+0000 7f39c3b3a640 1 --2- 172.21.15.43:0/2463434136 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f39a8078b90 0x7f39a807b0a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.408+0000 7f39c3b3a640 1 --2- 172.21.15.43:0/2463434136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39bc0c6f00 0x7f39bc1f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.408+0000 7f39c3b3a640 1 --2- 172.21.15.43:0/2463434136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39bc155d40 0x7f39bc14be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.408+0000 7f39c3b3a640 1 --2- 172.21.15.43:0/2463434136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39bc0c69b0 0x7f39bc0c9ff0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.408+0000 7f39c3b3a640 1 -- 172.21.15.43:0/2463434136 >> 172.21.15.43:0/2463434136 conn(0x7f39bc06f460 msgr2=0x7f39bc15c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:52.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.408+0000 7f39c3b3a640 1 -- 172.21.15.43:0/2463434136 shutdown_connections 2024-09-17T04:34:52.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.408+0000 7f39c3b3a640 1 -- 172.21.15.43:0/2463434136 wait complete. 2024-09-17T04:34:52.419 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:34:52.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.534+0000 7f4725be4640 1 -- 172.21.15.43:0/541903279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47200cc4c0 msgr2=0x7f472015f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:52.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.534+0000 7f4725be4640 1 --2- 172.21.15.43:0/541903279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47200cc4c0 0x7f472015f990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f472008e2c0 tx=0x7f471002a5f0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.535+0000 7f4725be4640 1 -- 172.21.15.43:0/541903279 shutdown_connections 2024-09-17T04:34:52.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.535+0000 7f4725be4640 1 --2- 172.21.15.43:0/541903279 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47200ce640 0x7f47200cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.535+0000 7f4725be4640 1 --2- 172.21.15.43:0/541903279 >> v2:172.21.15.62:3300/0 conn(0x7f47200ce230 0x7f47200cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.535+0000 7f4725be4640 1 --2- 172.21.15.43:0/541903279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47200cc4c0 0x7f472015f990 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.535+0000 7f4725be4640 1 -- 172.21.15.43:0/541903279 >> 172.21.15.43:0/541903279 conn(0x7f472006f4e0 msgr2=0x7f472006f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:52.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.535+0000 7f4725be4640 1 -- 172.21.15.43:0/541903279 shutdown_connections 2024-09-17T04:34:52.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.535+0000 7f4725be4640 1 -- 172.21.15.43:0/541903279 wait complete. 2024-09-17T04:34:52.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.536+0000 7f4725be4640 1 Processor -- start 2024-09-17T04:34:52.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.537+0000 7f4725be4640 1 -- start start 2024-09-17T04:34:52.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f4725be4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47200cc4c0 0x7f47200cf190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:52.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f4725be4640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47200ce230 0x7f472014c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:52.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f4725be4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47200ce640 0x7f472015dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:52.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f4725be4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f472015b990 con 0x7f47200cc4c0 2024-09-17T04:34:52.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f4725be4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f472015c2a0 con 0x7f47200ce640 2024-09-17T04:34:52.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f4725be4640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f47200ccbd0 con 0x7f47200ce230 2024-09-17T04:34:52.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f471f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47200cc4c0 0x7f47200cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:52.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f471f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47200cc4c0 0x7f47200cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41498/0 (socket says 172.21.15.43:41498) 2024-09-17T04:34:52.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f471f7fe640 1 -- 172.21.15.43:0/319686181 learned_addr learned my addr 172.21.15.43:0/319686181 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:52.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f471effd640 1 --2- 172.21.15.43:0/319686181 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47200ce230 0x7f472014c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:52.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f471ffff640 1 --2- 172.21.15.43:0/319686181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47200ce640 0x7f472015dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:52.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f471f7fe640 1 -- 172.21.15.43:0/319686181 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47200ce230 msgr2=0x7f472014c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:52.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f471f7fe640 1 --2- 172.21.15.43:0/319686181 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47200ce230 0x7f472014c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f471f7fe640 1 -- 172.21.15.43:0/319686181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47200ce640 msgr2=0x7f472015dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:52.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f471f7fe640 1 --2- 172.21.15.43:0/319686181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47200ce640 0x7f472015dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f471f7fe640 1 -- 172.21.15.43:0/319686181 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47200cf6d0 con 0x7f47200cc4c0 2024-09-17T04:34:52.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f471effd640 1 --2- 172.21.15.43:0/319686181 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47200ce230 0x7f472014c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:34:52.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.538+0000 7f471f7fe640 1 --2- 172.21.15.43:0/319686181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47200cc4c0 0x7f47200cf190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4710034040 tx=0x7f47100039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:52.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.539+0000 7f4707fff640 1 -- 172.21.15.43:0/319686181 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471003e030 con 0x7f47200cc4c0 2024-09-17T04:34:52.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.539+0000 7f4707fff640 1 -- 172.21.15.43:0/319686181 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47100047a0 con 0x7f47200cc4c0 2024-09-17T04:34:52.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.539+0000 7f4725be4640 1 -- 172.21.15.43:0/319686181 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4720154600 con 0x7f47200cc4c0 2024-09-17T04:34:52.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.539+0000 7f4707fff640 1 -- 172.21.15.43:0/319686181 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4710035040 con 0x7f47200cc4c0 2024-09-17T04:34:52.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.539+0000 7f4725be4640 1 -- 172.21.15.43:0/319686181 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47200d17f0 con 0x7f47200cc4c0 2024-09-17T04:34:52.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.540+0000 7f4725be4640 1 -- 172.21.15.43:0/319686181 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47200b6870 con 0x7f47200cc4c0 2024-09-17T04:34:52.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.540+0000 7f4707fff640 1 -- 172.21.15.43:0/319686181 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4710041030 con 0x7f47200cc4c0 2024-09-17T04:34:52.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.541+0000 7f4707fff640 1 --2- 172.21.15.43:0/319686181 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f470c078b90 0x7f470c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:52.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.541+0000 7f4707fff640 1 -- 172.21.15.43:0/319686181 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f47100bb3e0 con 0x7f47200cc4c0 2024-09-17T04:34:52.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.541+0000 7f471effd640 1 --2- 172.21.15.43:0/319686181 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f470c078b90 0x7f470c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:52.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.541+0000 7f471effd640 1 --2- 172.21.15.43:0/319686181 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f470c078b90 0x7f470c07b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f47201f5690 tx=0x7f4714005e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:52.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.545+0000 7f4707fff640 1 -- 172.21.15.43:0/319686181 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f47200b6870 con 0x7f47200cc4c0 2024-09-17T04:34:52.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.730+0000 7f4725be4640 1 -- 172.21.15.43:0/319686181 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f472015f990 con 0x7f47200cc4c0 2024-09-17T04:34:52.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.731+0000 7f4707fff640 1 -- 172.21.15.43:0/319686181 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16654 (secure 0 0 0) 0x7f4710083940 con 0x7f47200cc4c0 2024-09-17T04:34:52.731 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:34:52.732 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","created":"2024-09-17T04:34:26.485007+0000","modified":"2024-09-17T04:34:51.443588+0000","last_up_change":"2024-09-17T04:34:40.712497+0000","last_in_change":"2024-09-17T04:34:30.384271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:34:38.905735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:34:49.341236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:34:50.401489+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eaab925a-60b4-429f-aee1-50de6f32358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6817","nonce":1685480205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6819","nonce":1685480205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6823","nonce":1685480205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6821","nonce":1685480205}]},"public_addr":"172.21.15.43:6817/1685480205","cluster_addr":"172.21.15.43:6819/1685480205","heartbeat_back_addr":"172.21.15.43:6823/1685480205","heartbeat_front_addr":"172.21.15.43:6821/1685480205","state":["exists","up"]},{"osd":1,"uuid":"2c0e64be-db05-45db-aad8-2f2f42812100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6825","nonce":1564354446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6827","nonce":1564354446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6831","nonce":1564354446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6829","nonce":1564354446}]},"public_addr":"172.21.15.43:6825/1564354446","cluster_addr":"172.21.15.43:6827/1564354446","heartbeat_back_addr":"172.21.15.43:6831/1564354446","heartbeat_front_addr":"172.21.15.43:6829/1564354446","state":["exists","up"]},{"osd":2,"uuid":"fa88665d-2acb-4e44-99ac-1d496adf5b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6801","nonce":1385342605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6803","nonce":1385342605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6807","nonce":1385342605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6805","nonce":1385342605}]},"public_addr":"172.21.15.43:6801/1385342605","cluster_addr":"172.21.15.43:6803/1385342605","heartbeat_back_addr":"172.21.15.43:6807/1385342605","heartbeat_front_addr":"172.21.15.43:6805/1385342605","state":["exists","up"]},{"osd":3,"uuid":"710a28f0-d04a-4b4a-bba3-28f7c7b1eb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6809","nonce":1646004903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6811","nonce":1646004903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6815","nonce":1646004903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6813","nonce":1646004903}]},"public_addr":"172.21.15.43:6809/1646004903","cluster_addr":"172.21.15.43:6811/1646004903","heartbeat_back_addr":"172.21.15.43:6815/1646004903","heartbeat_front_addr":"172.21.15.43:6813/1646004903","state":["exists","up"]},{"osd":4,"uuid":"d2eca96b-1917-4dbb-b6e3-f4410bbc5c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6803","nonce":3991694106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6805","nonce":3991694106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6809","nonce":3991694106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6807","nonce":3991694106}]},"public_addr":"172.21.15.62:6803/3991694106","cluster_addr":"172.21.15.62:6805/3991694106","heartbeat_back_addr":"172.21.15.62:6809/3991694106","heartbeat_front_addr":"172.21.15.62:6807/3991694106","state":["exists","up"]},{"osd":5,"uuid":"ae843bea-38ff-4ca6-a7a9-6e58c7a17fd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6827","nonce":2558615114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6829","nonce":2558615114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6833","nonce":2558615114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6831","nonce":2558615114}]},"public_addr":"172.21.15.62:6827/2558615114","cluster_addr":"172.21.15.62:6829/2558615114","heartbeat_back_addr":"172.21.15.62:6833/2558615114","heartbeat_front_addr":"172.21.15.62:6831/2558615114","state":["exists","up"]},{"osd":6,"uuid":"44c53356-010d-443f-9e8d-f0d5da106893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6811","nonce":1901653154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6813","nonce":1901653154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6817","nonce":1901653154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6815","nonce":1901653154}]},"public_addr":"172.21.15.62:6811/1901653154","cluster_addr":"172.21.15.62:6813/1901653154","heartbeat_back_addr":"172.21.15.62:6817/1901653154","heartbeat_front_addr":"172.21.15.62:6815/1901653154","state":["exists","up"]},{"osd":7,"uuid":"c8960d11-dd10-4e36-b9d8-f1fdc0abe9c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6819","nonce":2974376041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6821","nonce":2974376041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6825","nonce":2974376041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6823","nonce":2974376041}]},"public_addr":"172.21.15.62:6819/2974376041","cluster_addr":"172.21.15.62:6821/2974376041","heartbeat_back_addr":"172.21.15.62:6825/2974376041","heartbeat_front_addr":"172.21.15.62:6823/2974376041","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.435063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.372079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:35.973575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.690029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.944690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.691776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.877497+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.689786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:34:52.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.733+0000 7f4725be4640 1 -- 172.21.15.43:0/319686181 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f470c078b90 msgr2=0x7f470c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:52.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.733+0000 7f4725be4640 1 --2- 172.21.15.43:0/319686181 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f470c078b90 0x7f470c07b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f47201f5690 tx=0x7f4714005e90 comp rx=0 tx=0).stop 2024-09-17T04:34:52.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.733+0000 7f4725be4640 1 -- 172.21.15.43:0/319686181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47200cc4c0 msgr2=0x7f47200cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:52.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.733+0000 7f4725be4640 1 --2- 172.21.15.43:0/319686181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47200cc4c0 0x7f47200cf190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4710034040 tx=0x7f47100039e0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.733+0000 7f4725be4640 1 -- 172.21.15.43:0/319686181 shutdown_connections 2024-09-17T04:34:52.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.733+0000 7f4725be4640 1 --2- 172.21.15.43:0/319686181 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f470c078b90 0x7f470c07b0a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.733+0000 7f4725be4640 1 --2- 172.21.15.43:0/319686181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47200ce640 0x7f472015dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.733+0000 7f4725be4640 1 --2- 172.21.15.43:0/319686181 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47200ce230 0x7f472014c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.733+0000 7f4725be4640 1 --2- 172.21.15.43:0/319686181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47200cc4c0 0x7f47200cf190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.733+0000 7f4725be4640 1 -- 172.21.15.43:0/319686181 >> 172.21.15.43:0/319686181 conn(0x7f472006f4e0 msgr2=0x7f472014e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:52.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.734+0000 7f4725be4640 1 -- 172.21.15.43:0/319686181 shutdown_connections 2024-09-17T04:34:52.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.734+0000 7f4725be4640 1 -- 172.21.15.43:0/319686181 wait complete. 2024-09-17T04:34:52.745 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T04:34:52.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.865+0000 7fde9956e640 1 -- 172.21.15.43:0/2621720052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde940c64a0 msgr2=0x7fde941558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:52.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.865+0000 7fde9956e640 1 --2- 172.21.15.43:0/2621720052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde940c64a0 0x7fde941558c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fde84005fd0 tx=0x7fde8402ab20 comp rx=0 tx=0).stop 2024-09-17T04:34:52.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.865+0000 7fde9956e640 1 -- 172.21.15.43:0/2621720052 shutdown_connections 2024-09-17T04:34:52.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.865+0000 7fde9956e640 1 --2- 172.21.15.43:0/2621720052 >> v2:172.21.15.62:3300/0 conn(0x7fde94068d00 0x7fde94069110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.865+0000 7fde9956e640 1 --2- 172.21.15.43:0/2621720052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde940c64a0 0x7fde941558c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.865+0000 7fde9956e640 1 -- 172.21.15.43:0/2621720052 >> 172.21.15.43:0/2621720052 conn(0x7fde940d0f90 msgr2=0x7fde940d13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:52.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.865+0000 7fde9956e640 1 -- 172.21.15.43:0/2621720052 shutdown_connections 2024-09-17T04:34:52.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.865+0000 7fde9956e640 1 -- 172.21.15.43:0/2621720052 wait complete. 2024-09-17T04:34:52.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.867+0000 7fde9956e640 1 Processor -- start 2024-09-17T04:34:52.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.867+0000 7fde9956e640 1 -- start start 2024-09-17T04:34:52.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.868+0000 7fde9956e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde94068d00 0x7fde940cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:52.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.868+0000 7fde9956e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde940c64a0 0x7fde941528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:52.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.868+0000 7fde9956e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde940cba00 0x7fde94152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:52.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.868+0000 7fde9956e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fde9415b890 con 0x7fde940c64a0 2024-09-17T04:34:52.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.868+0000 7fde9956e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fde9415c1a0 con 0x7fde94068d00 2024-09-17T04:34:52.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.868+0000 7fde9956e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fde9415c6c0 con 0x7fde940cba00 2024-09-17T04:34:52.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde92ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde94068d00 0x7fde940cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:52.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde927fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde940c64a0 0x7fde941528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:52.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde92ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde94068d00 0x7fde940cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:58948/0 (socket says 172.21.15.43:58948) 2024-09-17T04:34:52.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde92ffd640 1 -- 172.21.15.43:0/2964859037 learned_addr learned my addr 172.21.15.43:0/2964859037 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:52.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde937fe640 1 --2- 172.21.15.43:0/2964859037 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde940cba00 0x7fde94152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:52.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde937fe640 1 -- 172.21.15.43:0/2964859037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde94068d00 msgr2=0x7fde940cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:52.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde937fe640 1 --2- 172.21.15.43:0/2964859037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde94068d00 0x7fde940cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde937fe640 1 -- 172.21.15.43:0/2964859037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde940c64a0 msgr2=0x7fde941528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:52.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde937fe640 1 --2- 172.21.15.43:0/2964859037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde940c64a0 0x7fde941528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:52.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde937fe640 1 -- 172.21.15.43:0/2964859037 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde941e7c10 con 0x7fde940cba00 2024-09-17T04:34:52.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde92ffd640 1 --2- 172.21.15.43:0/2964859037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde94068d00 0x7fde940cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:34:52.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde927fc640 1 --2- 172.21.15.43:0/2964859037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde940c64a0 0x7fde941528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:34:52.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde937fe640 1 --2- 172.21.15.43:0/2964859037 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde940cba00 0x7fde94152e10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00e970 tx=0x7fde8c00ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:52.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde8b7fe640 1 -- 172.21.15.43:0/2964859037 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c00cc40 con 0x7fde940cba00 2024-09-17T04:34:52.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde8b7fe640 1 -- 172.21.15.43:0/2964859037 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde8c010430 con 0x7fde940cba00 2024-09-17T04:34:52.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde8b7fe640 1 -- 172.21.15.43:0/2964859037 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c010880 con 0x7fde940cba00 2024-09-17T04:34:52.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde9956e640 1 -- 172.21.15.43:0/2964859037 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde9415d8a0 con 0x7fde940cba00 2024-09-17T04:34:52.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.869+0000 7fde9956e640 1 -- 172.21.15.43:0/2964859037 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fde9406d4b0 con 0x7fde940cba00 2024-09-17T04:34:52.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.870+0000 7fde9956e640 1 -- 172.21.15.43:0/2964859037 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde940c7370 con 0x7fde940cba00 2024-09-17T04:34:52.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.871+0000 7fde8b7fe640 1 -- 172.21.15.43:0/2964859037 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde8c010a20 con 0x7fde940cba00 2024-09-17T04:34:52.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.872+0000 7fde8b7fe640 1 --2- 172.21.15.43:0/2964859037 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fde74078bc0 0x7fde7407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:52.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.872+0000 7fde8b7fe640 1 -- 172.21.15.43:0/2964859037 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fde8c09b800 con 0x7fde940cba00 2024-09-17T04:34:52.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.872+0000 7fde92ffd640 1 --2- 172.21.15.43:0/2964859037 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fde74078bc0 0x7fde7407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:52.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.872+0000 7fde92ffd640 1 --2- 172.21.15.43:0/2964859037 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fde74078bc0 0x7fde7407b0d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde8402cc90 tx=0x7fde84038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:52.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:52.876+0000 7fde8b7fe640 1 -- 172.21.15.43:0/2964859037 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde8c063660 con 0x7fde940cba00 2024-09-17T04:34:53.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:53.100+0000 7fde9956e640 1 -- 172.21.15.43:0/2964859037 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fde940c6070 con 0x7fde940cba00 2024-09-17T04:34:54.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.077+0000 7fde8b7fe640 1 -- 172.21.15.43:0/2964859037 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7fde8c099e20 con 0x7fde940cba00 2024-09-17T04:34:54.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.080+0000 7fde9956e640 1 -- 172.21.15.43:0/2964859037 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fde74078bc0 msgr2=0x7fde7407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:54.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.080+0000 7fde9956e640 1 --2- 172.21.15.43:0/2964859037 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fde74078bc0 0x7fde7407b0d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde8402cc90 tx=0x7fde84038040 comp rx=0 tx=0).stop 2024-09-17T04:34:54.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.080+0000 7fde9956e640 1 -- 172.21.15.43:0/2964859037 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde940cba00 msgr2=0x7fde94152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:54.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.080+0000 7fde9956e640 1 --2- 172.21.15.43:0/2964859037 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde940cba00 0x7fde94152e10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00e970 tx=0x7fde8c00ee30 comp rx=0 tx=0).stop 2024-09-17T04:34:54.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.081+0000 7fde9956e640 1 -- 172.21.15.43:0/2964859037 shutdown_connections 2024-09-17T04:34:54.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.081+0000 7fde9956e640 1 --2- 172.21.15.43:0/2964859037 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fde74078bc0 0x7fde7407b0d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:54.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.081+0000 7fde9956e640 1 --2- 172.21.15.43:0/2964859037 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde940cba00 0x7fde94152e10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:54.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.081+0000 7fde9956e640 1 --2- 172.21.15.43:0/2964859037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde940c64a0 0x7fde941528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:54.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.081+0000 7fde9956e640 1 --2- 172.21.15.43:0/2964859037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde94068d00 0x7fde940cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:54.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.081+0000 7fde9956e640 1 -- 172.21.15.43:0/2964859037 >> 172.21.15.43:0/2964859037 conn(0x7fde940d0f90 msgr2=0x7fde940d13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:54.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.081+0000 7fde9956e640 1 -- 172.21.15.43:0/2964859037 shutdown_connections 2024-09-17T04:34:54.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.081+0000 7fde9956e640 1 -- 172.21.15.43:0/2964859037 wait complete. 2024-09-17T04:34:54.094 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300} 2024-09-17T04:34:54.094 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-17T04:34:54.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.221+0000 7f9e1327e640 1 -- 172.21.15.43:0/617353226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9df4003ac0 msgr2=0x7f9df4003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:54.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.221+0000 7f9e1327e640 1 --2- 172.21.15.43:0/617353226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9df4003ac0 0x7f9df4003f30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9e04001050 tx=0x7f9df4005830 comp rx=0 tx=0).stop 2024-09-17T04:34:54.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.221+0000 7f9e1327e640 1 -- 172.21.15.43:0/617353226 shutdown_connections 2024-09-17T04:34:54.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.221+0000 7f9e1327e640 1 --2- 172.21.15.43:0/617353226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9df4003ac0 0x7f9df4003f30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:54.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.221+0000 7f9e1327e640 1 -- 172.21.15.43:0/617353226 >> 172.21.15.43:0/617353226 conn(0x7f9e0c0cdbc0 msgr2=0x7f9e0c0cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:54.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.221+0000 7f9e1327e640 1 -- 172.21.15.43:0/617353226 shutdown_connections 2024-09-17T04:34:54.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.221+0000 7f9e1327e640 1 -- 172.21.15.43:0/617353226 wait complete. 2024-09-17T04:34:54.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.223+0000 7f9e1327e640 1 Processor -- start 2024-09-17T04:34:54.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.223+0000 7f9e1327e640 1 -- start start 2024-09-17T04:34:54.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.224+0000 7f9e1327e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9df4003ac0 0x7f9e0c1e4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:54.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.224+0000 7f9e1327e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e0c15ef50 0x7f9e0c0b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:54.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.224+0000 7f9e1327e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e0c14bc40 0x7f9e0c1510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:54.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.224+0000 7f9e1327e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c0c6290 con 0x7f9e0c15ef50 2024-09-17T04:34:54.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.224+0000 7f9e1327e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c0c5fb0 con 0x7f9df4003ac0 2024-09-17T04:34:54.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.224+0000 7f9e1327e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9e0c155ab0 con 0x7f9e0c14bc40 2024-09-17T04:34:54.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.225+0000 7f9e10819640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e0c15ef50 0x7f9e0c0b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:54.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.225+0000 7f9e10819640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e0c15ef50 0x7f9e0c0b5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41524/0 (socket says 172.21.15.43:41524) 2024-09-17T04:34:54.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.225+0000 7f9e10819640 1 -- 172.21.15.43:0/943658575 learned_addr learned my addr 172.21.15.43:0/943658575 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:54.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.225+0000 7f9e1101a640 1 --2- 172.21.15.43:0/943658575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9df4003ac0 0x7f9e0c1e4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:54.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.225+0000 7f9e1181b640 1 --2- 172.21.15.43:0/943658575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e0c14bc40 0x7f9e0c1510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:54.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.225+0000 7f9e10819640 1 -- 172.21.15.43:0/943658575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e0c14bc40 msgr2=0x7f9e0c1510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:54.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.225+0000 7f9e10819640 1 --2- 172.21.15.43:0/943658575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e0c14bc40 0x7f9e0c1510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:54.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.225+0000 7f9e10819640 1 -- 172.21.15.43:0/943658575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9df4003ac0 msgr2=0x7f9e0c1e4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:54.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.225+0000 7f9e10819640 1 --2- 172.21.15.43:0/943658575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9df4003ac0 0x7f9e0c1e4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:54.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.225+0000 7f9e10819640 1 -- 172.21.15.43:0/943658575 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0c1e5460 con 0x7f9e0c15ef50 2024-09-17T04:34:54.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.225+0000 7f9e1101a640 1 --2- 172.21.15.43:0/943658575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9df4003ac0 0x7f9e0c1e4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:34:54.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.225+0000 7f9e1181b640 1 --2- 172.21.15.43:0/943658575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e0c14bc40 0x7f9e0c1510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:34:54.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.225+0000 7f9e10819640 1 --2- 172.21.15.43:0/943658575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e0c15ef50 0x7f9e0c0b5f00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9e00004ce0 tx=0x7f9e00001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:54.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.225+0000 7f9e09ffb640 1 -- 172.21.15.43:0/943658575 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e00015020 con 0x7f9e0c15ef50 2024-09-17T04:34:54.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.225+0000 7f9e09ffb640 1 -- 172.21.15.43:0/943658575 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e00011750 con 0x7f9e0c15ef50 2024-09-17T04:34:54.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.225+0000 7f9e1327e640 1 -- 172.21.15.43:0/943658575 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e0c1f1e10 con 0x7f9e0c15ef50 2024-09-17T04:34:54.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.225+0000 7f9e09ffb640 1 -- 172.21.15.43:0/943658575 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e00011b20 con 0x7f9e0c15ef50 2024-09-17T04:34:54.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.226+0000 7f9e1327e640 1 -- 172.21.15.43:0/943658575 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e0c1f20d0 con 0x7f9e0c15ef50 2024-09-17T04:34:54.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.226+0000 7f9e1327e640 1 -- 172.21.15.43:0/943658575 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e0c06d1c0 con 0x7f9e0c15ef50 2024-09-17T04:34:54.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.227+0000 7f9e09ffb640 1 -- 172.21.15.43:0/943658575 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e00018020 con 0x7f9e0c15ef50 2024-09-17T04:34:54.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.228+0000 7f9e09ffb640 1 --2- 172.21.15.43:0/943658575 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9df8078b90 0x7f9df807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:54.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.228+0000 7f9e09ffb640 1 -- 172.21.15.43:0/943658575 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9e0009b660 con 0x7f9e0c15ef50 2024-09-17T04:34:54.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.228+0000 7f9e1101a640 1 --2- 172.21.15.43:0/943658575 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9df8078b90 0x7f9df807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:54.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.229+0000 7f9e1101a640 1 --2- 172.21.15.43:0/943658575 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9df8078b90 0x7f9df807b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9e04033000 tx=0x7f9e040019f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:54.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.232+0000 7f9e09ffb640 1 -- 172.21.15.43:0/943658575 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9e0001f020 con 0x7f9e0c15ef50 2024-09-17T04:34:54.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:54.452+0000 7f9e1327e640 1 -- 172.21.15.43:0/943658575 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f9e0c1e4b40 con 0x7f9e0c15ef50 2024-09-17T04:34:55.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.083+0000 7f9e09ffb640 1 -- 172.21.15.43:0/943658575 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v6) ==== 105+0+0 (secure 0 0 0) 0x7f9e00063b20 con 0x7f9e0c15ef50 2024-09-17T04:34:55.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.088+0000 7f9e1327e640 1 -- 172.21.15.43:0/943658575 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9df8078b90 msgr2=0x7f9df807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:55.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.088+0000 7f9e1327e640 1 --2- 172.21.15.43:0/943658575 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9df8078b90 0x7f9df807b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9e04033000 tx=0x7f9e040019f0 comp rx=0 tx=0).stop 2024-09-17T04:34:55.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.088+0000 7f9e1327e640 1 -- 172.21.15.43:0/943658575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e0c15ef50 msgr2=0x7f9e0c0b5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:55.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.088+0000 7f9e1327e640 1 --2- 172.21.15.43:0/943658575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e0c15ef50 0x7f9e0c0b5f00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9e00004ce0 tx=0x7f9e00001630 comp rx=0 tx=0).stop 2024-09-17T04:34:55.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.088+0000 7f9e1327e640 1 -- 172.21.15.43:0/943658575 shutdown_connections 2024-09-17T04:34:55.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.088+0000 7f9e1327e640 1 --2- 172.21.15.43:0/943658575 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9df8078b90 0x7f9df807b0a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:55.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.088+0000 7f9e1327e640 1 --2- 172.21.15.43:0/943658575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e0c14bc40 0x7f9e0c1510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:55.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.088+0000 7f9e1327e640 1 --2- 172.21.15.43:0/943658575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e0c15ef50 0x7f9e0c0b5f00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:55.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.088+0000 7f9e1327e640 1 --2- 172.21.15.43:0/943658575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9df4003ac0 0x7f9e0c1e4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:55.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.088+0000 7f9e1327e640 1 -- 172.21.15.43:0/943658575 >> 172.21.15.43:0/943658575 conn(0x7f9e0c0cdbc0 msgr2=0x7f9e0c152180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:55.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.088+0000 7f9e1327e640 1 -- 172.21.15.43:0/943658575 shutdown_connections 2024-09-17T04:34:55.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.088+0000 7f9e1327e640 1 -- 172.21.15.43:0/943658575 wait complete. 2024-09-17T04:34:55.103 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T04:34:55.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.233+0000 7f8ba1339640 1 -- 172.21.15.43:0/3399912179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b9c0c7710 msgr2=0x7f8b9c0c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:55.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.233+0000 7f8ba1339640 1 --2- 172.21.15.43:0/3399912179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b9c0c7710 0x7f8b9c0c6050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c08e3e0 tx=0x7f8b9002a680 comp rx=0 tx=0).stop 2024-09-17T04:34:55.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.233+0000 7f8ba1339640 1 -- 172.21.15.43:0/3399912179 shutdown_connections 2024-09-17T04:34:55.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.233+0000 7f8ba1339640 1 --2- 172.21.15.43:0/3399912179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b9c0c7710 0x7f8b9c0c6050 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:55.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.233+0000 7f8ba1339640 1 --2- 172.21.15.43:0/3399912179 >> v2:172.21.15.62:3300/0 conn(0x7f8b9c155b20 0x7f8b9c0c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:55.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.233+0000 7f8ba1339640 1 -- 172.21.15.43:0/3399912179 >> 172.21.15.43:0/3399912179 conn(0x7f8b9c0cdbc0 msgr2=0x7f8b9c0cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:55.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.233+0000 7f8ba1339640 1 -- 172.21.15.43:0/3399912179 shutdown_connections 2024-09-17T04:34:55.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.233+0000 7f8ba1339640 1 -- 172.21.15.43:0/3399912179 wait complete. 2024-09-17T04:34:55.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.235+0000 7f8ba1339640 1 Processor -- start 2024-09-17T04:34:55.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.235+0000 7f8ba1339640 1 -- start start 2024-09-17T04:34:55.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8ba1339640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b9c0c6590 0x7f8b9c0ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:55.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8ba1339640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b9c0c7710 0x7f8b9c151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:55.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8ba1339640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b9c155b20 0x7f8b9c0cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:55.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8ba1339640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c0c69a0 con 0x7f8b9c0c7710 2024-09-17T04:34:55.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8ba1339640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c06dd00 con 0x7f8b9c0c6590 2024-09-17T04:34:55.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8ba1339640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9c0b4e20 con 0x7f8b9c155b20 2024-09-17T04:34:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8b9a7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b9c0c7710 0x7f8b9c151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8b9a7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b9c0c7710 0x7f8b9c151630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41536/0 (socket says 172.21.15.43:41536) 2024-09-17T04:34:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8b9a7fc640 1 -- 172.21.15.43:0/2440516259 learned_addr learned my addr 172.21.15.43:0/2440516259 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8b9affd640 1 --2- 172.21.15.43:0/2440516259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b9c0c6590 0x7f8b9c0ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8b9b7fe640 1 --2- 172.21.15.43:0/2440516259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b9c155b20 0x7f8b9c0cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8b9a7fc640 1 -- 172.21.15.43:0/2440516259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b9c155b20 msgr2=0x7f8b9c0cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8b9a7fc640 1 --2- 172.21.15.43:0/2440516259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b9c155b20 0x7f8b9c0cfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8b9a7fc640 1 -- 172.21.15.43:0/2440516259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b9c0c6590 msgr2=0x7f8b9c0ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8b9a7fc640 1 --2- 172.21.15.43:0/2440516259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b9c0c6590 0x7f8b9c0ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8b9a7fc640 1 -- 172.21.15.43:0/2440516259 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c156d60 con 0x7f8b9c0c7710 2024-09-17T04:34:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8b9a7fc640 1 --2- 172.21.15.43:0/2440516259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b9c0c7710 0x7f8b9c151630 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8b90034040 tx=0x7f8b90003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.237+0000 7f8b837fe640 1 -- 172.21.15.43:0/2440516259 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9003e030 con 0x7f8b9c0c7710 2024-09-17T04:34:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.238+0000 7f8b837fe640 1 -- 172.21.15.43:0/2440516259 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b90003e00 con 0x7f8b9c0c7710 2024-09-17T04:34:55.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.238+0000 7f8ba1339640 1 -- 172.21.15.43:0/2440516259 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b9c0d0b40 con 0x7f8b9c0c7710 2024-09-17T04:34:55.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.238+0000 7f8b837fe640 1 -- 172.21.15.43:0/2440516259 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90035040 con 0x7f8b9c0c7710 2024-09-17T04:34:55.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.238+0000 7f8ba1339640 1 -- 172.21.15.43:0/2440516259 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b9c1587b0 con 0x7f8b9c0c7710 2024-09-17T04:34:55.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.239+0000 7f8ba1339640 1 -- 172.21.15.43:0/2440516259 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b9c0ccd50 con 0x7f8b9c0c7710 2024-09-17T04:34:55.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.239+0000 7f8b837fe640 1 -- 172.21.15.43:0/2440516259 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b90041030 con 0x7f8b9c0c7710 2024-09-17T04:34:55.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.240+0000 7f8b837fe640 1 --2- 172.21.15.43:0/2440516259 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8b88078b90 0x7f8b8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:55.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.240+0000 7f8b837fe640 1 -- 172.21.15.43:0/2440516259 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8b900bb460 con 0x7f8b9c0c7710 2024-09-17T04:34:55.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.240+0000 7f8b9affd640 1 --2- 172.21.15.43:0/2440516259 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8b88078b90 0x7f8b8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:55.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.241+0000 7f8b9affd640 1 --2- 172.21.15.43:0/2440516259 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8b88078b90 0x7f8b8807b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c005fd0 tx=0x7f8b8c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:55.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.245+0000 7f8b837fe640 1 -- 172.21.15.43:0/2440516259 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8b90083370 con 0x7f8b9c0c7710 2024-09-17T04:34:55.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:55.470+0000 7f8ba1339640 1 -- 172.21.15.43:0/2440516259 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8b9c0d08d0 con 0x7f8b9c0c7710 2024-09-17T04:34:56.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.085+0000 7f8b837fe640 1 -- 172.21.15.43:0/2440516259 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7f8b90087da0 con 0x7f8b9c0c7710 2024-09-17T04:34:56.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.088+0000 7f8ba1339640 1 -- 172.21.15.43:0/2440516259 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8b88078b90 msgr2=0x7f8b8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:56.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.088+0000 7f8ba1339640 1 --2- 172.21.15.43:0/2440516259 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8b88078b90 0x7f8b8807b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c005fd0 tx=0x7f8b8c00b2e0 comp rx=0 tx=0).stop 2024-09-17T04:34:56.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.088+0000 7f8ba1339640 1 -- 172.21.15.43:0/2440516259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b9c0c7710 msgr2=0x7f8b9c151630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:56.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.088+0000 7f8ba1339640 1 --2- 172.21.15.43:0/2440516259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b9c0c7710 0x7f8b9c151630 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8b90034040 tx=0x7f8b90003910 comp rx=0 tx=0).stop 2024-09-17T04:34:56.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.088+0000 7f8ba1339640 1 -- 172.21.15.43:0/2440516259 shutdown_connections 2024-09-17T04:34:56.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.088+0000 7f8ba1339640 1 --2- 172.21.15.43:0/2440516259 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8b88078b90 0x7f8b8807b0a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:56.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.088+0000 7f8ba1339640 1 --2- 172.21.15.43:0/2440516259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b9c155b20 0x7f8b9c0cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:56.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.088+0000 7f8ba1339640 1 --2- 172.21.15.43:0/2440516259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b9c0c7710 0x7f8b9c151630 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:56.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.088+0000 7f8ba1339640 1 --2- 172.21.15.43:0/2440516259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b9c0c6590 0x7f8b9c0ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:56.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.088+0000 7f8ba1339640 1 -- 172.21.15.43:0/2440516259 >> 172.21.15.43:0/2440516259 conn(0x7f8b9c0cdbc0 msgr2=0x7f8b9c0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:56.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.088+0000 7f8ba1339640 1 -- 172.21.15.43:0/2440516259 shutdown_connections 2024-09-17T04:34:56.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.088+0000 7f8ba1339640 1 -- 172.21.15.43:0/2440516259 wait complete. 2024-09-17T04:34:56.103 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-17T04:34:56.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.231+0000 7fd50d9e6640 1 -- 172.21.15.43:0/3005460902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4f0004e00 msgr2=0x7fd4f0005290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:56.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.231+0000 7fd50d9e6640 1 --2- 172.21.15.43:0/3005460902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4f0004e00 0x7fd4f0005290 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd5080c6360 tx=0x7fd4f0005830 comp rx=0 tx=0).stop 2024-09-17T04:34:56.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.231+0000 7fd5077fe640 1 -- 172.21.15.43:0/3005460902 reap_dead start 2024-09-17T04:34:56.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.231+0000 7fd50d9e6640 1 -- 172.21.15.43:0/3005460902 shutdown_connections 2024-09-17T04:34:56.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.231+0000 7fd50d9e6640 1 -- 172.21.15.43:0/3005460902 >> 172.21.15.43:0/3005460902 conn(0x7fd508070700 msgr2=0x7fd508068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:56.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.231+0000 7fd50d9e6640 1 -- 172.21.15.43:0/3005460902 shutdown_connections 2024-09-17T04:34:56.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.231+0000 7fd50d9e6640 1 -- 172.21.15.43:0/3005460902 wait complete. 2024-09-17T04:34:56.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.233+0000 7fd50d9e6640 1 Processor -- start 2024-09-17T04:34:56.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.233+0000 7fd50d9e6640 1 -- start start 2024-09-17T04:34:56.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.234+0000 7fd50d9e6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4f0004e00 0x7fd5081f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:56.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.234+0000 7fd50d9e6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd50806f2d0 0x7fd5081e50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:56.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.234+0000 7fd50d9e6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5080cd6a0 0x7fd50814dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:56.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.234+0000 7fd50d9e6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd5080c8f10 con 0x7fd4f0004e00 2024-09-17T04:34:56.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.234+0000 7fd50d9e6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd5080c96c0 con 0x7fd5080cd6a0 2024-09-17T04:34:56.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.234+0000 7fd50d9e6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd5080c9090 con 0x7fd50806f2d0 2024-09-17T04:34:56.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.234+0000 7fd506ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4f0004e00 0x7fd5081f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:56.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.234+0000 7fd506ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4f0004e00 0x7fd5081f4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41564/0 (socket says 172.21.15.43:41564) 2024-09-17T04:34:56.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.234+0000 7fd506ffd640 1 -- 172.21.15.43:0/3530961263 learned_addr learned my addr 172.21.15.43:0/3530961263 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:56.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.234+0000 7fd5077fe640 1 --2- 172.21.15.43:0/3530961263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5080cd6a0 0x7fd50814dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:56.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.234+0000 7fd5067fc640 1 --2- 172.21.15.43:0/3530961263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd50806f2d0 0x7fd5081e50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:56.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.234+0000 7fd506ffd640 1 -- 172.21.15.43:0/3530961263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd50806f2d0 msgr2=0x7fd5081e50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:56.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.234+0000 7fd506ffd640 1 --2- 172.21.15.43:0/3530961263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd50806f2d0 0x7fd5081e50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:56.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.234+0000 7fd506ffd640 1 -- 172.21.15.43:0/3530961263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5080cd6a0 msgr2=0x7fd50814dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:56.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.234+0000 7fd506ffd640 1 --2- 172.21.15.43:0/3530961263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5080cd6a0 0x7fd50814dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:56.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.234+0000 7fd506ffd640 1 -- 172.21.15.43:0/3530961263 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5081f5420 con 0x7fd4f0004e00 2024-09-17T04:34:56.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.234+0000 7fd5067fc640 1 --2- 172.21.15.43:0/3530961263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd50806f2d0 0x7fd5081e50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:34:56.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.235+0000 7fd506ffd640 1 --2- 172.21.15.43:0/3530961263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4f0004e00 0x7fd5081f4ee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8003ec0 tx=0x7fd4f8001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:56.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.235+0000 7fd4effff640 1 -- 172.21.15.43:0/3530961263 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8015070 con 0x7fd4f0004e00 2024-09-17T04:34:56.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.235+0000 7fd4effff640 1 -- 172.21.15.43:0/3530961263 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4f8011920 con 0x7fd4f0004e00 2024-09-17T04:34:56.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.235+0000 7fd50d9e6640 1 -- 172.21.15.43:0/3530961263 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5080b4c50 con 0x7fd4f0004e00 2024-09-17T04:34:56.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.235+0000 7fd4effff640 1 -- 172.21.15.43:0/3530961263 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8011d70 con 0x7fd4f0004e00 2024-09-17T04:34:56.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.235+0000 7fd50d9e6640 1 -- 172.21.15.43:0/3530961263 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5081f2480 con 0x7fd4f0004e00 2024-09-17T04:34:56.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.236+0000 7fd50d9e6640 1 -- 172.21.15.43:0/3530961263 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd50806fe40 con 0x7fd4f0004e00 2024-09-17T04:34:56.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.237+0000 7fd4effff640 1 -- 172.21.15.43:0/3530961263 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd4f8018070 con 0x7fd4f0004e00 2024-09-17T04:34:56.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.237+0000 7fd4effff640 1 --2- 172.21.15.43:0/3530961263 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fd4f4078bc0 0x7fd4f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:56.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.237+0000 7fd4effff640 1 -- 172.21.15.43:0/3530961263 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd4f809b9c0 con 0x7fd4f0004e00 2024-09-17T04:34:56.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.238+0000 7fd5067fc640 1 --2- 172.21.15.43:0/3530961263 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fd4f4078bc0 0x7fd4f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:56.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.238+0000 7fd5067fc640 1 --2- 172.21.15.43:0/3530961263 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fd4f4078bc0 0x7fd4f407b0d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc000c00 tx=0x7fd4fc001b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:56.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.242+0000 7fd4effff640 1 -- 172.21.15.43:0/3530961263 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd4f809de20 con 0x7fd4f0004e00 2024-09-17T04:34:56.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:56.464+0000 7fd50d9e6640 1 -- 172.21.15.43:0/3530961263 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fd5081f26c0 con 0x7fd4f0004e00 2024-09-17T04:34:57.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.092+0000 7fd4effff640 1 -- 172.21.15.43:0/3530961263 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v8) ==== 115+0+0 (secure 0 0 0) 0x7fd4f8063f20 con 0x7fd4f0004e00 2024-09-17T04:34:57.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.095+0000 7fd50d9e6640 1 -- 172.21.15.43:0/3530961263 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fd4f4078bc0 msgr2=0x7fd4f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:57.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.095+0000 7fd50d9e6640 1 --2- 172.21.15.43:0/3530961263 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fd4f4078bc0 0x7fd4f407b0d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc000c00 tx=0x7fd4fc001b10 comp rx=0 tx=0).stop 2024-09-17T04:34:57.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.095+0000 7fd50d9e6640 1 -- 172.21.15.43:0/3530961263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4f0004e00 msgr2=0x7fd5081f4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:57.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.095+0000 7fd50d9e6640 1 --2- 172.21.15.43:0/3530961263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4f0004e00 0x7fd5081f4ee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8003ec0 tx=0x7fd4f8001800 comp rx=0 tx=0).stop 2024-09-17T04:34:57.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.095+0000 7fd50d9e6640 1 -- 172.21.15.43:0/3530961263 shutdown_connections 2024-09-17T04:34:57.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.095+0000 7fd50d9e6640 1 --2- 172.21.15.43:0/3530961263 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fd4f4078bc0 0x7fd4f407b0d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.095+0000 7fd50d9e6640 1 --2- 172.21.15.43:0/3530961263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5080cd6a0 0x7fd50814dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.095+0000 7fd50d9e6640 1 --2- 172.21.15.43:0/3530961263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd50806f2d0 0x7fd5081e50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.095+0000 7fd50d9e6640 1 --2- 172.21.15.43:0/3530961263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4f0004e00 0x7fd5081f4ee0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.095+0000 7fd50d9e6640 1 -- 172.21.15.43:0/3530961263 >> 172.21.15.43:0/3530961263 conn(0x7fd508070700 msgr2=0x7fd508157420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.095+0000 7fd50d9e6640 1 -- 172.21.15.43:0/3530961263 shutdown_connections 2024-09-17T04:34:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.095+0000 7fd50d9e6640 1 -- 172.21.15.43:0/3530961263 wait complete. 2024-09-17T04:34:57.109 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T04:34:57.109 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:34:57.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.230+0000 7f745d1ad640 1 -- 172.21.15.43:0/785494009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74580cc4c0 msgr2=0x7f745815f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:57.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.230+0000 7f745d1ad640 1 --2- 172.21.15.43:0/785494009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74580cc4c0 0x7f745815f990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7448005fd0 tx=0x7f744802a670 comp rx=0 tx=0).stop 2024-09-17T04:34:57.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.230+0000 7f745d1ad640 1 -- 172.21.15.43:0/785494009 shutdown_connections 2024-09-17T04:34:57.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.230+0000 7f745d1ad640 1 --2- 172.21.15.43:0/785494009 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74580ce230 0x7f74580cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.230+0000 7f745d1ad640 1 --2- 172.21.15.43:0/785494009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74580cc4c0 0x7f745815f990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.230+0000 7f745d1ad640 1 -- 172.21.15.43:0/785494009 >> 172.21.15.43:0/785494009 conn(0x7f745806f4e0 msgr2=0x7f745806f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:57.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.230+0000 7f745d1ad640 1 -- 172.21.15.43:0/785494009 shutdown_connections 2024-09-17T04:34:57.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.231+0000 7f745d1ad640 1 -- 172.21.15.43:0/785494009 wait complete. 2024-09-17T04:34:57.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.233+0000 7f745d1ad640 1 Processor -- start 2024-09-17T04:34:57.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.233+0000 7f745d1ad640 1 -- start start 2024-09-17T04:34:57.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.234+0000 7f745d1ad640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74580cc4c0 0x7f74581f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:57.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.234+0000 7f745d1ad640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74580ce230 0x7f7458156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:57.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.234+0000 7f745d1ad640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74580ce640 0x7f74580c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:57.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.234+0000 7f745d1ad640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f745815b990 con 0x7f74580ce640 2024-09-17T04:34:57.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.234+0000 7f745d1ad640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f745815c2a0 con 0x7f74580cc4c0 2024-09-17T04:34:57.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.234+0000 7f745d1ad640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f74580ccbd0 con 0x7f74580ce230 2024-09-17T04:34:57.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.234+0000 7f745759e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74580ce640 0x7f74580c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:57.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.234+0000 7f745759e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74580ce640 0x7f74580c6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41582/0 (socket says 172.21.15.43:41582) 2024-09-17T04:34:57.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.234+0000 7f745759e640 1 -- 172.21.15.43:0/2044974448 learned_addr learned my addr 172.21.15.43:0/2044974448 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:57.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.234+0000 7f7456d9d640 1 --2- 172.21.15.43:0/2044974448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74580cc4c0 0x7f74581f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:57.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.234+0000 7f745659c640 1 --2- 172.21.15.43:0/2044974448 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74580ce230 0x7f7458156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:57.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.234+0000 7f745759e640 1 -- 172.21.15.43:0/2044974448 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74580ce230 msgr2=0x7f7458156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:57.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.234+0000 7f745759e640 1 --2- 172.21.15.43:0/2044974448 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74580ce230 0x7f7458156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.234+0000 7f745759e640 1 -- 172.21.15.43:0/2044974448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74580cc4c0 msgr2=0x7f74581f5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:57.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.234+0000 7f745759e640 1 --2- 172.21.15.43:0/2044974448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74580cc4c0 0x7f74581f5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.234+0000 7f745759e640 1 -- 172.21.15.43:0/2044974448 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74580d19a0 con 0x7f74580ce640 2024-09-17T04:34:57.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.234+0000 7f745759e640 1 --2- 172.21.15.43:0/2044974448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74580ce640 0x7f74580c6800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f745000c6e0 tx=0x7f745000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:57.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.235+0000 7f743f7fe640 1 -- 172.21.15.43:0/2044974448 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7450003b70 con 0x7f74580ce640 2024-09-17T04:34:57.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.235+0000 7f743f7fe640 1 -- 172.21.15.43:0/2044974448 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7450003d30 con 0x7f74580ce640 2024-09-17T04:34:57.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.235+0000 7f743f7fe640 1 -- 172.21.15.43:0/2044974448 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7450005330 con 0x7f74580ce640 2024-09-17T04:34:57.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.235+0000 7f745d1ad640 1 -- 172.21.15.43:0/2044974448 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74581f6090 con 0x7f74580ce640 2024-09-17T04:34:57.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.235+0000 7f745d1ad640 1 -- 172.21.15.43:0/2044974448 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74580d1c10 con 0x7f74580ce640 2024-09-17T04:34:57.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.236+0000 7f745d1ad640 1 -- 172.21.15.43:0/2044974448 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74580b6870 con 0x7f74580ce640 2024-09-17T04:34:57.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.237+0000 7f743f7fe640 1 -- 172.21.15.43:0/2044974448 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f74500054d0 con 0x7f74580ce640 2024-09-17T04:34:57.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.237+0000 7f743f7fe640 1 --2- 172.21.15.43:0/2044974448 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7444078bc0 0x7f744407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:57.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.237+0000 7f743f7fe640 1 -- 172.21.15.43:0/2044974448 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f745009a9c0 con 0x7f74580ce640 2024-09-17T04:34:57.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.237+0000 7f7456d9d640 1 --2- 172.21.15.43:0/2044974448 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7444078bc0 0x7f744407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:57.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.238+0000 7f7456d9d640 1 --2- 172.21.15.43:0/2044974448 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7444078bc0 0x7f744407b0d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7448033000 tx=0x7f7448004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:57.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.242+0000 7f743f7fe640 1 -- 172.21.15.43:0/2044974448 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f74580b6870 con 0x7f74580ce640 2024-09-17T04:34:57.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.463+0000 7f745d1ad640 1 -- 172.21.15.43:0/2044974448 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7458076da0 con 0x7f74580ce640 2024-09-17T04:34:57.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.463+0000 7f743f7fe640 1 -- 172.21.15.43:0/2044974448 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6849 (secure 0 0 0) 0x7f7458076da0 con 0x7f74580ce640 2024-09-17T04:34:57.463 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:34:57.463 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":8,"btime":"2024-09-17T04:34:57:086209+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/424910095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6835","nonce":424910095},{"type":"v1","addr":"172.21.15.62:6837","nonce":424910095}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6836/882111784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":882111784},{"type":"v1","addr":"172.21.15.62:6836","nonce":882111784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4431,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/47250523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":47250523},{"type":"v1","addr":"172.21.15.43:6834","nonce":47250523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4434,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3276393888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":3276393888},{"type":"v1","addr":"172.21.15.43:6835","nonce":3276393888}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3935895854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":3935895854},{"type":"v1","addr":"172.21.15.43:6837","nonce":3935895854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:34:51.443546+0000","modified":"2024-09-17T04:34:56.465816+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0],"up":{"mds_0":4455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4455":{"gid":4455,"name":"f","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.62:6839/3263944095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3263944095},{"type":"v1","addr":"172.21.15.62:6839","nonce":3263944095}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T04:34:57.464 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 8 2024-09-17T04:34:57.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.465+0000 7f745d1ad640 1 -- 172.21.15.43:0/2044974448 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7444078bc0 msgr2=0x7f744407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:57.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.465+0000 7f745d1ad640 1 --2- 172.21.15.43:0/2044974448 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7444078bc0 0x7f744407b0d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7448033000 tx=0x7f7448004730 comp rx=0 tx=0).stop 2024-09-17T04:34:57.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.465+0000 7f745d1ad640 1 -- 172.21.15.43:0/2044974448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74580ce640 msgr2=0x7f74580c6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:57.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.465+0000 7f745d1ad640 1 --2- 172.21.15.43:0/2044974448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74580ce640 0x7f74580c6800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f745000c6e0 tx=0x7f745000cba0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.465+0000 7f745d1ad640 1 -- 172.21.15.43:0/2044974448 shutdown_connections 2024-09-17T04:34:57.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.465+0000 7f745d1ad640 1 --2- 172.21.15.43:0/2044974448 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7444078bc0 0x7f744407b0d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.465+0000 7f745d1ad640 1 --2- 172.21.15.43:0/2044974448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74580ce640 0x7f74580c6800 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.465+0000 7f745d1ad640 1 --2- 172.21.15.43:0/2044974448 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74580ce230 0x7f7458156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.465+0000 7f745d1ad640 1 --2- 172.21.15.43:0/2044974448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74580cc4c0 0x7f74581f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.465+0000 7f745d1ad640 1 -- 172.21.15.43:0/2044974448 >> 172.21.15.43:0/2044974448 conn(0x7f745806f4e0 msgr2=0x7f7458159800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:57.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.465+0000 7f745d1ad640 1 -- 172.21.15.43:0/2044974448 shutdown_connections 2024-09-17T04:34:57.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.465+0000 7f745d1ad640 1 -- 172.21.15.43:0/2044974448 wait complete. 2024-09-17T04:34:57.477 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:34:57.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.593+0000 7f826f194640 1 -- 172.21.15.43:0/1717319336 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8254003ff0 msgr2=0x7f8254004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:57.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.593+0000 7f826f194640 1 --2- 172.21.15.43:0/1717319336 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8254003ff0 0x7f8254004800 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8258009b50 tx=0x7f8254005830 comp rx=0 tx=0).stop 2024-09-17T04:34:57.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.593+0000 7f826d731640 1 -- 172.21.15.43:0/1717319336 reap_dead start 2024-09-17T04:34:57.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.593+0000 7f826f194640 1 -- 172.21.15.43:0/1717319336 shutdown_connections 2024-09-17T04:34:57.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.593+0000 7f826f194640 1 -- 172.21.15.43:0/1717319336 >> 172.21.15.43:0/1717319336 conn(0x7f826806f4e0 msgr2=0x7f826806f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:57.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.593+0000 7f826f194640 1 -- 172.21.15.43:0/1717319336 shutdown_connections 2024-09-17T04:34:57.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.593+0000 7f826f194640 1 -- 172.21.15.43:0/1717319336 wait complete. 2024-09-17T04:34:57.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.595+0000 7f826f194640 1 Processor -- start 2024-09-17T04:34:57.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.595+0000 7f826f194640 1 -- start start 2024-09-17T04:34:57.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.596+0000 7f826f194640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8254003ff0 0x7f82681e2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:57.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.596+0000 7f826f194640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f826815ab70 0x7f82681f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:57.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.596+0000 7f826f194640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82680cf8e0 0x7f82680cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:57.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.596+0000 7f826f194640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f82680b5ab0 con 0x7f82680cf8e0 2024-09-17T04:34:57.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.596+0000 7f826f194640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f82680b57d0 con 0x7f826815ab70 2024-09-17T04:34:57.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.596+0000 7f826f194640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f82680b5fd0 con 0x7f8254003ff0 2024-09-17T04:34:57.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.596+0000 7f826d731640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82680cf8e0 0x7f82680cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:57.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.596+0000 7f826d731640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82680cf8e0 0x7f82680cfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41600/0 (socket says 172.21.15.43:41600) 2024-09-17T04:34:57.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.596+0000 7f826d731640 1 -- 172.21.15.43:0/4033794589 learned_addr learned my addr 172.21.15.43:0/4033794589 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:57.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.596+0000 7f826cf30640 1 --2- 172.21.15.43:0/4033794589 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8254003ff0 0x7f82681e2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:57.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.596+0000 7f8267fff640 1 --2- 172.21.15.43:0/4033794589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f826815ab70 0x7f82681f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:57.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.596+0000 7f826d731640 1 -- 172.21.15.43:0/4033794589 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8254003ff0 msgr2=0x7f82681e2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:57.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.596+0000 7f826d731640 1 --2- 172.21.15.43:0/4033794589 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8254003ff0 0x7f82681e2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.596+0000 7f826d731640 1 -- 172.21.15.43:0/4033794589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f826815ab70 msgr2=0x7f82681f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:57.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.596+0000 7f826d731640 1 --2- 172.21.15.43:0/4033794589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f826815ab70 0x7f82681f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.596+0000 7f826d731640 1 -- 172.21.15.43:0/4033794589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82681f2290 con 0x7f82680cf8e0 2024-09-17T04:34:57.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.597+0000 7f826d731640 1 --2- 172.21.15.43:0/4033794589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82680cf8e0 0x7f82680cfcf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8260005fd0 tx=0x7f826000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:57.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.597+0000 7f82657fa640 1 -- 172.21.15.43:0/4033794589 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260004b20 con 0x7f82680cf8e0 2024-09-17T04:34:57.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.597+0000 7f82657fa640 1 -- 172.21.15.43:0/4033794589 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8260004cc0 con 0x7f82680cf8e0 2024-09-17T04:34:57.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.597+0000 7f826f194640 1 -- 172.21.15.43:0/4033794589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82681589b0 con 0x7f82680cf8e0 2024-09-17T04:34:57.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.597+0000 7f82657fa640 1 -- 172.21.15.43:0/4033794589 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260003bd0 con 0x7f82680cf8e0 2024-09-17T04:34:57.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.597+0000 7f826f194640 1 -- 172.21.15.43:0/4033794589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82681f1550 con 0x7f82680cf8e0 2024-09-17T04:34:57.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.598+0000 7f826f194640 1 -- 172.21.15.43:0/4033794589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82681f1340 con 0x7f82680cf8e0 2024-09-17T04:34:57.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.599+0000 7f82657fa640 1 -- 172.21.15.43:0/4033794589 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8260004030 con 0x7f82680cf8e0 2024-09-17T04:34:57.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.599+0000 7f82657fa640 1 --2- 172.21.15.43:0/4033794589 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8248078b90 0x7f824807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:57.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.599+0000 7f82657fa640 1 -- 172.21.15.43:0/4033794589 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f826009b240 con 0x7f82680cf8e0 2024-09-17T04:34:57.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.599+0000 7f826cf30640 1 --2- 172.21.15.43:0/4033794589 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8248078b90 0x7f824807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:57.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.600+0000 7f826cf30640 1 --2- 172.21.15.43:0/4033794589 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8248078b90 0x7f824807b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f82500013b0 tx=0x7f8250001060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:57.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.604+0000 7f82657fa640 1 -- 172.21.15.43:0/4033794589 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8260063670 con 0x7f82680cf8e0 2024-09-17T04:34:57.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.789+0000 7f826f194640 1 -- 172.21.15.43:0/4033794589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82680ccd60 con 0x7f82680cf8e0 2024-09-17T04:34:57.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.790+0000 7f82657fa640 1 -- 172.21.15.43:0/4033794589 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16641 (secure 0 0 0) 0x7f8260062f70 con 0x7f82680cf8e0 2024-09-17T04:34:57.790 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:34:57.790 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":22,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","created":"2024-09-17T04:34:26.485007+0000","modified":"2024-09-17T04:34:53.066747+0000","last_up_change":"2024-09-17T04:34:40.712497+0000","last_in_change":"2024-09-17T04:34:30.384271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:34:38.905735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:34:49.341236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:34:50.401489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eaab925a-60b4-429f-aee1-50de6f32358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6817","nonce":1685480205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6819","nonce":1685480205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6823","nonce":1685480205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6821","nonce":1685480205}]},"public_addr":"172.21.15.43:6817/1685480205","cluster_addr":"172.21.15.43:6819/1685480205","heartbeat_back_addr":"172.21.15.43:6823/1685480205","heartbeat_front_addr":"172.21.15.43:6821/1685480205","state":["exists","up"]},{"osd":1,"uuid":"2c0e64be-db05-45db-aad8-2f2f42812100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6825","nonce":1564354446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6827","nonce":1564354446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6831","nonce":1564354446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6829","nonce":1564354446}]},"public_addr":"172.21.15.43:6825/1564354446","cluster_addr":"172.21.15.43:6827/1564354446","heartbeat_back_addr":"172.21.15.43:6831/1564354446","heartbeat_front_addr":"172.21.15.43:6829/1564354446","state":["exists","up"]},{"osd":2,"uuid":"fa88665d-2acb-4e44-99ac-1d496adf5b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6801","nonce":1385342605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6803","nonce":1385342605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6807","nonce":1385342605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6805","nonce":1385342605}]},"public_addr":"172.21.15.43:6801/1385342605","cluster_addr":"172.21.15.43:6803/1385342605","heartbeat_back_addr":"172.21.15.43:6807/1385342605","heartbeat_front_addr":"172.21.15.43:6805/1385342605","state":["exists","up"]},{"osd":3,"uuid":"710a28f0-d04a-4b4a-bba3-28f7c7b1eb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6809","nonce":1646004903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6811","nonce":1646004903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6815","nonce":1646004903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6813","nonce":1646004903}]},"public_addr":"172.21.15.43:6809/1646004903","cluster_addr":"172.21.15.43:6811/1646004903","heartbeat_back_addr":"172.21.15.43:6815/1646004903","heartbeat_front_addr":"172.21.15.43:6813/1646004903","state":["exists","up"]},{"osd":4,"uuid":"d2eca96b-1917-4dbb-b6e3-f4410bbc5c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6803","nonce":3991694106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6805","nonce":3991694106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6809","nonce":3991694106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6807","nonce":3991694106}]},"public_addr":"172.21.15.62:6803/3991694106","cluster_addr":"172.21.15.62:6805/3991694106","heartbeat_back_addr":"172.21.15.62:6809/3991694106","heartbeat_front_addr":"172.21.15.62:6807/3991694106","state":["exists","up"]},{"osd":5,"uuid":"ae843bea-38ff-4ca6-a7a9-6e58c7a17fd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6827","nonce":2558615114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6829","nonce":2558615114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6833","nonce":2558615114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6831","nonce":2558615114}]},"public_addr":"172.21.15.62:6827/2558615114","cluster_addr":"172.21.15.62:6829/2558615114","heartbeat_back_addr":"172.21.15.62:6833/2558615114","heartbeat_front_addr":"172.21.15.62:6831/2558615114","state":["exists","up"]},{"osd":6,"uuid":"44c53356-010d-443f-9e8d-f0d5da106893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6811","nonce":1901653154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6813","nonce":1901653154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6817","nonce":1901653154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6815","nonce":1901653154}]},"public_addr":"172.21.15.62:6811/1901653154","cluster_addr":"172.21.15.62:6813/1901653154","heartbeat_back_addr":"172.21.15.62:6817/1901653154","heartbeat_front_addr":"172.21.15.62:6815/1901653154","state":["exists","up"]},{"osd":7,"uuid":"c8960d11-dd10-4e36-b9d8-f1fdc0abe9c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6819","nonce":2974376041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6821","nonce":2974376041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6825","nonce":2974376041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6823","nonce":2974376041}]},"public_addr":"172.21.15.62:6819/2974376041","cluster_addr":"172.21.15.62:6821/2974376041","heartbeat_back_addr":"172.21.15.62:6825/2974376041","heartbeat_front_addr":"172.21.15.62:6823/2974376041","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.435063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.372079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:35.973575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.690029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.944690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.691776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.877497+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.689786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:34:57.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.792+0000 7f826f194640 1 -- 172.21.15.43:0/4033794589 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8248078b90 msgr2=0x7f824807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:57.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.792+0000 7f826f194640 1 --2- 172.21.15.43:0/4033794589 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8248078b90 0x7f824807b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f82500013b0 tx=0x7f8250001060 comp rx=0 tx=0).stop 2024-09-17T04:34:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.792+0000 7f826f194640 1 -- 172.21.15.43:0/4033794589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82680cf8e0 msgr2=0x7f82680cfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.792+0000 7f826f194640 1 --2- 172.21.15.43:0/4033794589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82680cf8e0 0x7f82680cfcf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8260005fd0 tx=0x7f826000f3c0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.792+0000 7f826f194640 1 -- 172.21.15.43:0/4033794589 shutdown_connections 2024-09-17T04:34:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.792+0000 7f826f194640 1 --2- 172.21.15.43:0/4033794589 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8248078b90 0x7f824807b0a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.792+0000 7f826f194640 1 --2- 172.21.15.43:0/4033794589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f826815ab70 0x7f82681f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.792+0000 7f826f194640 1 --2- 172.21.15.43:0/4033794589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82680cf8e0 0x7f82680cfcf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.792+0000 7f826f194640 1 --2- 172.21.15.43:0/4033794589 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8254003ff0 0x7f82681e2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.792+0000 7f826f194640 1 -- 172.21.15.43:0/4033794589 >> 172.21.15.43:0/4033794589 conn(0x7f826806f4e0 msgr2=0x7f82680762b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.793+0000 7f826f194640 1 -- 172.21.15.43:0/4033794589 shutdown_connections 2024-09-17T04:34:57.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.793+0000 7f826f194640 1 -- 172.21.15.43:0/4033794589 wait complete. 2024-09-17T04:34:57.804 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T04:34:57.804 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:34:57.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.920+0000 7f981d8c5640 1 -- 172.21.15.43:0/3124818059 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9818155d40 msgr2=0x7f981815eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:57.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.920+0000 7f981d8c5640 1 --2- 172.21.15.43:0/3124818059 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9818155d40 0x7f981815eef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9800009860 tx=0x7f980002a5a0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.920+0000 7f981d8c5640 1 -- 172.21.15.43:0/3124818059 shutdown_connections 2024-09-17T04:34:57.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.920+0000 7f981d8c5640 1 --2- 172.21.15.43:0/3124818059 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9818155d40 0x7f981815eef0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.920+0000 7f981d8c5640 1 -- 172.21.15.43:0/3124818059 >> 172.21.15.43:0/3124818059 conn(0x7f981806f460 msgr2=0x7f981806f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:57.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.920+0000 7f981d8c5640 1 -- 172.21.15.43:0/3124818059 shutdown_connections 2024-09-17T04:34:57.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.920+0000 7f981d8c5640 1 -- 172.21.15.43:0/3124818059 wait complete. 2024-09-17T04:34:57.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.922+0000 7f981d8c5640 1 Processor -- start 2024-09-17T04:34:57.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.922+0000 7f981d8c5640 1 -- start start 2024-09-17T04:34:57.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.923+0000 7f981d8c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98180c69b0 0x7f9818154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:57.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.923+0000 7f981d8c5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98180c6f00 0x7f981814b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:57.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.923+0000 7f981d8c5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9818155d40 0x7f981814bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:57.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.923+0000 7f981d8c5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f98180c7730 con 0x7f9818155d40 2024-09-17T04:34:57.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.923+0000 7f981d8c5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f98180c7aa0 con 0x7f98180c69b0 2024-09-17T04:34:57.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.923+0000 7f981d8c5640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f98180b4d50 con 0x7f98180c6f00 2024-09-17T04:34:57.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.923+0000 7f98177fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9818155d40 0x7f981814bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:57.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.923+0000 7f98177fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9818155d40 0x7f981814bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41610/0 (socket says 172.21.15.43:41610) 2024-09-17T04:34:57.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.923+0000 7f98177fe640 1 -- 172.21.15.43:0/3635859120 learned_addr learned my addr 172.21.15.43:0/3635859120 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:57.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.923+0000 7f9816ffd640 1 --2- 172.21.15.43:0/3635859120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98180c69b0 0x7f9818154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:57.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.923+0000 7f98167fc640 1 --2- 172.21.15.43:0/3635859120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98180c6f00 0x7f981814b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:57.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.924+0000 7f98177fe640 1 -- 172.21.15.43:0/3635859120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98180c6f00 msgr2=0x7f981814b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:57.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.924+0000 7f98177fe640 1 --2- 172.21.15.43:0/3635859120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98180c6f00 0x7f981814b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.924+0000 7f98177fe640 1 -- 172.21.15.43:0/3635859120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98180c69b0 msgr2=0x7f9818154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:57.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.924+0000 7f98177fe640 1 --2- 172.21.15.43:0/3635859120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98180c69b0 0x7f9818154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:57.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.924+0000 7f98177fe640 1 -- 172.21.15.43:0/3635859120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9818156520 con 0x7f9818155d40 2024-09-17T04:34:57.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.924+0000 7f98177fe640 1 --2- 172.21.15.43:0/3635859120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9818155d40 0x7f981814bdd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f981000c3c0 tx=0x7f9810001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:57.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.924+0000 7f980ffff640 1 -- 172.21.15.43:0/3635859120 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9810017070 con 0x7f9818155d40 2024-09-17T04:34:57.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.924+0000 7f980ffff640 1 -- 172.21.15.43:0/3635859120 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98100053e0 con 0x7f9818155d40 2024-09-17T04:34:57.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.924+0000 7f980ffff640 1 -- 172.21.15.43:0/3635859120 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9810003850 con 0x7f9818155d40 2024-09-17T04:34:57.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.924+0000 7f981d8c5640 1 -- 172.21.15.43:0/3635859120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9818157dd0 con 0x7f9818155d40 2024-09-17T04:34:57.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.924+0000 7f981d8c5640 1 -- 172.21.15.43:0/3635859120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9818158390 con 0x7f9818155d40 2024-09-17T04:34:57.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.925+0000 7f981d8c5640 1 -- 172.21.15.43:0/3635859120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98180d1de0 con 0x7f9818155d40 2024-09-17T04:34:57.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.926+0000 7f980ffff640 1 -- 172.21.15.43:0/3635859120 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f981001a070 con 0x7f9818155d40 2024-09-17T04:34:57.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.926+0000 7f980ffff640 1 --2- 172.21.15.43:0/3635859120 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f97f8078b90 0x7f97f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:57.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.926+0000 7f980ffff640 1 -- 172.21.15.43:0/3635859120 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9810099ef0 con 0x7f9818155d40 2024-09-17T04:34:57.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.926+0000 7f9816ffd640 1 --2- 172.21.15.43:0/3635859120 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f97f8078b90 0x7f97f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:57.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.927+0000 7f9816ffd640 1 --2- 172.21.15.43:0/3635859120 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f97f8078b90 0x7f97f807b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f98080017a0 tx=0x7f9808001730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:57.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:57.931+0000 7f980ffff640 1 -- 172.21.15.43:0/3635859120 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9810061ec0 con 0x7f9818155d40 2024-09-17T04:34:58.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.118+0000 7f981d8c5640 1 -- 172.21.15.43:0/3635859120 --> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f981806a900 con 0x7f97f8078b90 2024-09-17T04:34:58.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.123+0000 7f980ffff640 1 -- 172.21.15.43:0/3635859120 <== mgr.4100 v2:172.21.15.62:6800/1186143747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7f981806a900 con 0x7f97f8078b90 2024-09-17T04:34:58.126 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:34:58.127 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-17T04:34:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.126+0000 7f981d8c5640 1 -- 172.21.15.43:0/3635859120 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f97f8078b90 msgr2=0x7f97f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.126+0000 7f981d8c5640 1 --2- 172.21.15.43:0/3635859120 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f97f8078b90 0x7f97f807b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f98080017a0 tx=0x7f9808001730 comp rx=0 tx=0).stop 2024-09-17T04:34:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.126+0000 7f981d8c5640 1 -- 172.21.15.43:0/3635859120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9818155d40 msgr2=0x7f981814bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.126+0000 7f981d8c5640 1 --2- 172.21.15.43:0/3635859120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9818155d40 0x7f981814bdd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f981000c3c0 tx=0x7f9810001e70 comp rx=0 tx=0).stop 2024-09-17T04:34:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.126+0000 7f981d8c5640 1 -- 172.21.15.43:0/3635859120 shutdown_connections 2024-09-17T04:34:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.126+0000 7f981d8c5640 1 --2- 172.21.15.43:0/3635859120 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f97f8078b90 0x7f97f807b0a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.126+0000 7f981d8c5640 1 --2- 172.21.15.43:0/3635859120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9818155d40 0x7f981814bdd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.126+0000 7f981d8c5640 1 --2- 172.21.15.43:0/3635859120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98180c6f00 0x7f981814b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.126+0000 7f981d8c5640 1 --2- 172.21.15.43:0/3635859120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98180c69b0 0x7f9818154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.126+0000 7f981d8c5640 1 -- 172.21.15.43:0/3635859120 >> 172.21.15.43:0/3635859120 conn(0x7f981806f460 msgr2=0x7f981815b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.126+0000 7f981d8c5640 1 -- 172.21.15.43:0/3635859120 shutdown_connections 2024-09-17T04:34:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.126+0000 7f981d8c5640 1 -- 172.21.15.43:0/3635859120 wait complete. 2024-09-17T04:34:58.137 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-17T04:34:56.890674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239916,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734804,"statfs":{"total":773094113280,"available":772848439296,"internally_reserved":0,"allocated":2924544,"data_stored":1793104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001567"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079958+0000","last_change":"2024-09-17T04:34:52.082794+0000","last_active":"2024-09-17T04:34:53.079958+0000","last_peered":"2024-09-17T04:34:53.079958+0000","last_clean":"2024-09-17T04:34:53.079958+0000","last_became_active":"2024-09-17T04:34:52.081216+0000","last_became_peered":"2024-09-17T04:34:52.081216+0000","last_unstale":"2024-09-17T04:34:53.079958+0000","last_undegraded":"2024-09-17T04:34:53.079958+0000","last_fullsized":"2024-09-17T04:34:53.079958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:32.229667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075998+0000","last_change":"2024-09-17T04:34:52.071762+0000","last_active":"2024-09-17T04:34:53.075998+0000","last_peered":"2024-09-17T04:34:53.075998+0000","last_clean":"2024-09-17T04:34:53.075998+0000","last_became_active":"2024-09-17T04:34:52.071488+0000","last_became_peered":"2024-09-17T04:34:52.071488+0000","last_unstale":"2024-09-17T04:34:53.075998+0000","last_undegraded":"2024-09-17T04:34:53.075998+0000","last_fullsized":"2024-09-17T04:34:53.075998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:00.729921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315645+0000","last_change":"2024-09-17T04:34:52.073360+0000","last_active":"2024-09-17T04:34:53.315645+0000","last_peered":"2024-09-17T04:34:53.315645+0000","last_clean":"2024-09-17T04:34:53.315645+0000","last_became_active":"2024-09-17T04:34:52.073014+0000","last_became_peered":"2024-09-17T04:34:52.073014+0000","last_unstale":"2024-09-17T04:34:53.315645+0000","last_undegraded":"2024-09-17T04:34:53.315645+0000","last_fullsized":"2024-09-17T04:34:53.315645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:14.331608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081622+0000","last_change":"2024-09-17T04:34:52.077679+0000","last_active":"2024-09-17T04:34:53.081622+0000","last_peered":"2024-09-17T04:34:53.081622+0000","last_clean":"2024-09-17T04:34:53.081622+0000","last_became_active":"2024-09-17T04:34:52.077306+0000","last_became_peered":"2024-09-17T04:34:52.077306+0000","last_unstale":"2024-09-17T04:34:53.081622+0000","last_undegraded":"2024-09-17T04:34:53.081622+0000","last_fullsized":"2024-09-17T04:34:53.081622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:44.967159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080748+0000","last_change":"2024-09-17T04:34:52.075036+0000","last_active":"2024-09-17T04:34:53.080748+0000","last_peered":"2024-09-17T04:34:53.080748+0000","last_clean":"2024-09-17T04:34:53.080748+0000","last_became_active":"2024-09-17T04:34:52.074649+0000","last_became_peered":"2024-09-17T04:34:52.074649+0000","last_unstale":"2024-09-17T04:34:53.080748+0000","last_undegraded":"2024-09-17T04:34:53.080748+0000","last_fullsized":"2024-09-17T04:34:53.080748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:22.293746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081410+0000","last_change":"2024-09-17T04:34:52.081059+0000","last_active":"2024-09-17T04:34:53.081410+0000","last_peered":"2024-09-17T04:34:53.081410+0000","last_clean":"2024-09-17T04:34:53.081410+0000","last_became_active":"2024-09-17T04:34:52.080677+0000","last_became_peered":"2024-09-17T04:34:52.080677+0000","last_unstale":"2024-09-17T04:34:53.081410+0000","last_undegraded":"2024-09-17T04:34:53.081410+0000","last_fullsized":"2024-09-17T04:34:53.081410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:52.404672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079328+0000","last_change":"2024-09-17T04:34:52.071135+0000","last_active":"2024-09-17T04:34:53.079328+0000","last_peered":"2024-09-17T04:34:53.079328+0000","last_clean":"2024-09-17T04:34:53.079328+0000","last_became_active":"2024-09-17T04:34:52.070844+0000","last_became_peered":"2024-09-17T04:34:52.070844+0000","last_unstale":"2024-09-17T04:34:53.079328+0000","last_undegraded":"2024-09-17T04:34:53.079328+0000","last_fullsized":"2024-09-17T04:34:53.079328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:02.373675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176836+0000","last_change":"2024-09-17T04:34:52.083343+0000","last_active":"2024-09-17T04:34:53.176836+0000","last_peered":"2024-09-17T04:34:53.176836+0000","last_clean":"2024-09-17T04:34:53.176836+0000","last_became_active":"2024-09-17T04:34:52.083008+0000","last_became_peered":"2024-09-17T04:34:52.083008+0000","last_unstale":"2024-09-17T04:34:53.176836+0000","last_undegraded":"2024-09-17T04:34:53.176836+0000","last_fullsized":"2024-09-17T04:34:53.176836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:02.710077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079639+0000","last_change":"2024-09-17T04:34:52.083331+0000","last_active":"2024-09-17T04:34:53.079639+0000","last_peered":"2024-09-17T04:34:53.079639+0000","last_clean":"2024-09-17T04:34:53.079639+0000","last_became_active":"2024-09-17T04:34:52.082984+0000","last_became_peered":"2024-09-17T04:34:52.082984+0000","last_unstale":"2024-09-17T04:34:53.079639+0000","last_undegraded":"2024-09-17T04:34:53.079639+0000","last_fullsized":"2024-09-17T04:34:53.079639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:56.779776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080623+0000","last_change":"2024-09-17T04:34:52.087207+0000","last_active":"2024-09-17T04:34:53.080623+0000","last_peered":"2024-09-17T04:34:53.080623+0000","last_clean":"2024-09-17T04:34:53.080623+0000","last_became_active":"2024-09-17T04:34:52.086885+0000","last_became_peered":"2024-09-17T04:34:52.086885+0000","last_unstale":"2024-09-17T04:34:53.080623+0000","last_undegraded":"2024-09-17T04:34:53.080623+0000","last_fullsized":"2024-09-17T04:34:53.080623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:52.121338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.078802+0000","last_change":"2024-09-17T04:34:52.086309+0000","last_active":"2024-09-17T04:34:53.078802+0000","last_peered":"2024-09-17T04:34:53.078802+0000","last_clean":"2024-09-17T04:34:53.078802+0000","last_became_active":"2024-09-17T04:34:52.085996+0000","last_became_peered":"2024-09-17T04:34:52.085996+0000","last_unstale":"2024-09-17T04:34:53.078802+0000","last_undegraded":"2024-09-17T04:34:53.078802+0000","last_fullsized":"2024-09-17T04:34:53.078802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:58.004980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318081+0000","last_change":"2024-09-17T04:34:52.077080+0000","last_active":"2024-09-17T04:34:53.318081+0000","last_peered":"2024-09-17T04:34:53.318081+0000","last_clean":"2024-09-17T04:34:53.318081+0000","last_became_active":"2024-09-17T04:34:52.076756+0000","last_became_peered":"2024-09-17T04:34:52.076756+0000","last_unstale":"2024-09-17T04:34:53.318081+0000","last_undegraded":"2024-09-17T04:34:53.318081+0000","last_fullsized":"2024-09-17T04:34:53.318081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:48.044400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177180+0000","last_change":"2024-09-17T04:34:52.076609+0000","last_active":"2024-09-17T04:34:53.177180+0000","last_peered":"2024-09-17T04:34:53.177180+0000","last_clean":"2024-09-17T04:34:53.177180+0000","last_became_active":"2024-09-17T04:34:52.076277+0000","last_became_peered":"2024-09-17T04:34:52.076277+0000","last_unstale":"2024-09-17T04:34:53.177180+0000","last_undegraded":"2024-09-17T04:34:53.177180+0000","last_fullsized":"2024-09-17T04:34:53.177180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:28.537566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315331+0000","last_change":"2024-09-17T04:34:52.076754+0000","last_active":"2024-09-17T04:34:53.315331+0000","last_peered":"2024-09-17T04:34:53.315331+0000","last_clean":"2024-09-17T04:34:53.315331+0000","last_became_active":"2024-09-17T04:34:52.076261+0000","last_became_peered":"2024-09-17T04:34:52.076261+0000","last_unstale":"2024-09-17T04:34:53.315331+0000","last_undegraded":"2024-09-17T04:34:53.315331+0000","last_fullsized":"2024-09-17T04:34:53.315331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:51.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075849+0000","last_change":"2024-09-17T04:34:52.079161+0000","last_active":"2024-09-17T04:34:53.075849+0000","last_peered":"2024-09-17T04:34:53.075849+0000","last_clean":"2024-09-17T04:34:53.075849+0000","last_became_active":"2024-09-17T04:34:52.078782+0000","last_became_peered":"2024-09-17T04:34:52.078782+0000","last_unstale":"2024-09-17T04:34:53.075849+0000","last_undegraded":"2024-09-17T04:34:53.075849+0000","last_fullsized":"2024-09-17T04:34:53.075849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:06.894137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080646+0000","last_change":"2024-09-17T04:34:52.070767+0000","last_active":"2024-09-17T04:34:53.080646+0000","last_peered":"2024-09-17T04:34:53.080646+0000","last_clean":"2024-09-17T04:34:53.080646+0000","last_became_active":"2024-09-17T04:34:52.070428+0000","last_became_peered":"2024-09-17T04:34:52.070428+0000","last_unstale":"2024-09-17T04:34:53.080646+0000","last_undegraded":"2024-09-17T04:34:53.080646+0000","last_fullsized":"2024-09-17T04:34:53.080646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:42.820391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.082014+0000","last_change":"2024-09-17T04:34:52.077238+0000","last_active":"2024-09-17T04:34:53.082014+0000","last_peered":"2024-09-17T04:34:53.082014+0000","last_clean":"2024-09-17T04:34:53.082014+0000","last_became_active":"2024-09-17T04:34:52.076897+0000","last_became_peered":"2024-09-17T04:34:52.076897+0000","last_unstale":"2024-09-17T04:34:53.082014+0000","last_undegraded":"2024-09-17T04:34:53.082014+0000","last_fullsized":"2024-09-17T04:34:53.082014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:27.431184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.316114+0000","last_change":"2024-09-17T04:34:52.080917+0000","last_active":"2024-09-17T04:34:53.316114+0000","last_peered":"2024-09-17T04:34:53.316114+0000","last_clean":"2024-09-17T04:34:53.316114+0000","last_became_active":"2024-09-17T04:34:52.080597+0000","last_became_peered":"2024-09-17T04:34:52.080597+0000","last_unstale":"2024-09-17T04:34:53.316114+0000","last_undegraded":"2024-09-17T04:34:53.316114+0000","last_fullsized":"2024-09-17T04:34:53.316114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:10.560075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080159+0000","last_change":"2024-09-17T04:34:52.077284+0000","last_active":"2024-09-17T04:34:53.080159+0000","last_peered":"2024-09-17T04:34:53.080159+0000","last_clean":"2024-09-17T04:34:53.080159+0000","last_became_active":"2024-09-17T04:34:52.076950+0000","last_became_peered":"2024-09-17T04:34:52.076950+0000","last_unstale":"2024-09-17T04:34:53.080159+0000","last_undegraded":"2024-09-17T04:34:53.080159+0000","last_fullsized":"2024-09-17T04:34:53.080159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:06.361530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079837+0000","last_change":"2024-09-17T04:34:52.083859+0000","last_active":"2024-09-17T04:34:53.079837+0000","last_peered":"2024-09-17T04:34:53.079837+0000","last_clean":"2024-09-17T04:34:53.079837+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:34:53.079837+0000","last_undegraded":"2024-09-17T04:34:53.079837+0000","last_fullsized":"2024-09-17T04:34:53.079837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:25.262925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315556+0000","last_change":"2024-09-17T04:34:52.086460+0000","last_active":"2024-09-17T04:34:53.315556+0000","last_peered":"2024-09-17T04:34:53.315556+0000","last_clean":"2024-09-17T04:34:53.315556+0000","last_became_active":"2024-09-17T04:34:52.084848+0000","last_became_peered":"2024-09-17T04:34:52.084848+0000","last_unstale":"2024-09-17T04:34:53.315556+0000","last_undegraded":"2024-09-17T04:34:53.315556+0000","last_fullsized":"2024-09-17T04:34:53.315556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:22.927331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081424+0000","last_change":"2024-09-17T04:34:52.080149+0000","last_active":"2024-09-17T04:34:53.081424+0000","last_peered":"2024-09-17T04:34:53.081424+0000","last_clean":"2024-09-17T04:34:53.081424+0000","last_became_active":"2024-09-17T04:34:52.079490+0000","last_became_peered":"2024-09-17T04:34:52.079490+0000","last_unstale":"2024-09-17T04:34:53.081424+0000","last_undegraded":"2024-09-17T04:34:53.081424+0000","last_fullsized":"2024-09-17T04:34:53.081424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:52.314715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176860+0000","last_change":"2024-09-17T04:34:52.082765+0000","last_active":"2024-09-17T04:34:53.176860+0000","last_peered":"2024-09-17T04:34:53.176860+0000","last_clean":"2024-09-17T04:34:53.176860+0000","last_became_active":"2024-09-17T04:34:52.081049+0000","last_became_peered":"2024-09-17T04:34:52.081049+0000","last_unstale":"2024-09-17T04:34:53.176860+0000","last_undegraded":"2024-09-17T04:34:53.176860+0000","last_fullsized":"2024-09-17T04:34:53.176860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.762553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081112+0000","last_change":"2024-09-17T04:34:52.086233+0000","last_active":"2024-09-17T04:34:53.081112+0000","last_peered":"2024-09-17T04:34:53.081112+0000","last_clean":"2024-09-17T04:34:53.081112+0000","last_became_active":"2024-09-17T04:34:52.085876+0000","last_became_peered":"2024-09-17T04:34:52.085876+0000","last_unstale":"2024-09-17T04:34:53.081112+0000","last_undegraded":"2024-09-17T04:34:53.081112+0000","last_fullsized":"2024-09-17T04:34:53.081112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:44.061677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177349+0000","last_change":"2024-09-17T04:34:52.079305+0000","last_active":"2024-09-17T04:34:53.177349+0000","last_peered":"2024-09-17T04:34:53.177349+0000","last_clean":"2024-09-17T04:34:53.177349+0000","last_became_active":"2024-09-17T04:34:52.078984+0000","last_became_peered":"2024-09-17T04:34:52.078984+0000","last_unstale":"2024-09-17T04:34:53.177349+0000","last_undegraded":"2024-09-17T04:34:53.177349+0000","last_fullsized":"2024-09-17T04:34:53.177349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:15.927488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080877+0000","last_change":"2024-09-17T04:34:52.077495+0000","last_active":"2024-09-17T04:34:53.080877+0000","last_peered":"2024-09-17T04:34:53.080877+0000","last_clean":"2024-09-17T04:34:53.080877+0000","last_became_active":"2024-09-17T04:34:52.077167+0000","last_became_peered":"2024-09-17T04:34:52.077167+0000","last_unstale":"2024-09-17T04:34:53.080877+0000","last_undegraded":"2024-09-17T04:34:53.080877+0000","last_fullsized":"2024-09-17T04:34:53.080877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.411611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076209+0000","last_change":"2024-09-17T04:34:52.077389+0000","last_active":"2024-09-17T04:34:53.076209+0000","last_peered":"2024-09-17T04:34:53.076209+0000","last_clean":"2024-09-17T04:34:53.076209+0000","last_became_active":"2024-09-17T04:34:52.076993+0000","last_became_peered":"2024-09-17T04:34:52.076993+0000","last_unstale":"2024-09-17T04:34:53.076209+0000","last_undegraded":"2024-09-17T04:34:53.076209+0000","last_fullsized":"2024-09-17T04:34:53.076209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:18.540098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177228+0000","last_change":"2024-09-17T04:34:52.080545+0000","last_active":"2024-09-17T04:34:53.177228+0000","last_peered":"2024-09-17T04:34:53.177228+0000","last_clean":"2024-09-17T04:34:53.177228+0000","last_became_active":"2024-09-17T04:34:52.079930+0000","last_became_peered":"2024-09-17T04:34:52.079930+0000","last_unstale":"2024-09-17T04:34:53.177228+0000","last_undegraded":"2024-09-17T04:34:53.177228+0000","last_fullsized":"2024-09-17T04:34:53.177228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:50.491050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315714+0000","last_change":"2024-09-17T04:34:52.083598+0000","last_active":"2024-09-17T04:34:53.315714+0000","last_peered":"2024-09-17T04:34:53.315714+0000","last_clean":"2024-09-17T04:34:53.315714+0000","last_became_active":"2024-09-17T04:34:52.083225+0000","last_became_peered":"2024-09-17T04:34:52.083225+0000","last_unstale":"2024-09-17T04:34:53.315714+0000","last_undegraded":"2024-09-17T04:34:53.315714+0000","last_fullsized":"2024-09-17T04:34:53.315714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:22.713546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081731+0000","last_change":"2024-09-17T04:34:52.078977+0000","last_active":"2024-09-17T04:34:53.081731+0000","last_peered":"2024-09-17T04:34:53.081731+0000","last_clean":"2024-09-17T04:34:53.081731+0000","last_became_active":"2024-09-17T04:34:52.078636+0000","last_became_peered":"2024-09-17T04:34:52.078636+0000","last_unstale":"2024-09-17T04:34:53.081731+0000","last_undegraded":"2024-09-17T04:34:53.081731+0000","last_fullsized":"2024-09-17T04:34:53.081731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:30.144564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315840+0000","last_change":"2024-09-17T04:34:52.082113+0000","last_active":"2024-09-17T04:34:53.315840+0000","last_peered":"2024-09-17T04:34:53.315840+0000","last_clean":"2024-09-17T04:34:53.315840+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:34:53.315840+0000","last_undegraded":"2024-09-17T04:34:53.315840+0000","last_fullsized":"2024-09-17T04:34:53.315840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:52.744564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.078708+0000","last_change":"2024-09-17T04:34:52.083306+0000","last_active":"2024-09-17T04:34:53.078708+0000","last_peered":"2024-09-17T04:34:53.078708+0000","last_clean":"2024-09-17T04:34:53.078708+0000","last_became_active":"2024-09-17T04:34:52.082590+0000","last_became_peered":"2024-09-17T04:34:52.082590+0000","last_unstale":"2024-09-17T04:34:53.078708+0000","last_undegraded":"2024-09-17T04:34:53.078708+0000","last_fullsized":"2024-09-17T04:34:53.078708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:21.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.317989+0000","last_change":"2024-09-17T04:34:52.070155+0000","last_active":"2024-09-17T04:34:53.317989+0000","last_peered":"2024-09-17T04:34:53.317989+0000","last_clean":"2024-09-17T04:34:53.317989+0000","last_became_active":"2024-09-17T04:34:52.069498+0000","last_became_peered":"2024-09-17T04:34:52.069498+0000","last_unstale":"2024-09-17T04:34:53.317989+0000","last_undegraded":"2024-09-17T04:34:53.317989+0000","last_fullsized":"2024-09-17T04:34:53.317989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:24.539277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177313+0000","last_change":"2024-09-17T04:34:51.074188+0000","last_active":"2024-09-17T04:34:53.177313+0000","last_peered":"2024-09-17T04:34:53.177313+0000","last_clean":"2024-09-17T04:34:53.177313+0000","last_became_active":"2024-09-17T04:34:51.073740+0000","last_became_peered":"2024-09-17T04:34:51.073740+0000","last_unstale":"2024-09-17T04:34:53.177313+0000","last_undegraded":"2024-09-17T04:34:53.177313+0000","last_fullsized":"2024-09-17T04:34:53.177313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:36.692687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315954+0000","last_change":"2024-09-17T04:34:52.081048+0000","last_active":"2024-09-17T04:34:53.315954+0000","last_peered":"2024-09-17T04:34:53.315954+0000","last_clean":"2024-09-17T04:34:53.315954+0000","last_became_active":"2024-09-17T04:34:52.080703+0000","last_became_peered":"2024-09-17T04:34:52.080703+0000","last_unstale":"2024-09-17T04:34:53.315954+0000","last_undegraded":"2024-09-17T04:34:53.315954+0000","last_fullsized":"2024-09-17T04:34:53.315954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:05.164849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079196+0000","last_change":"2024-09-17T04:34:51.078602+0000","last_active":"2024-09-17T04:34:53.079196+0000","last_peered":"2024-09-17T04:34:53.079196+0000","last_clean":"2024-09-17T04:34:53.079196+0000","last_became_active":"2024-09-17T04:34:51.078221+0000","last_became_peered":"2024-09-17T04:34:51.078221+0000","last_unstale":"2024-09-17T04:34:53.079196+0000","last_undegraded":"2024-09-17T04:34:53.079196+0000","last_fullsized":"2024-09-17T04:34:53.079196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:59.716216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176933+0000","last_change":"2024-09-17T04:34:51.077573+0000","last_active":"2024-09-17T04:34:53.176933+0000","last_peered":"2024-09-17T04:34:53.176933+0000","last_clean":"2024-09-17T04:34:53.176933+0000","last_became_active":"2024-09-17T04:34:51.077225+0000","last_became_peered":"2024-09-17T04:34:51.077225+0000","last_unstale":"2024-09-17T04:34:53.176933+0000","last_undegraded":"2024-09-17T04:34:53.176933+0000","last_fullsized":"2024-09-17T04:34:53.176933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:29.348927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176928+0000","last_change":"2024-09-17T04:34:52.074356+0000","last_active":"2024-09-17T04:34:53.176928+0000","last_peered":"2024-09-17T04:34:53.176928+0000","last_clean":"2024-09-17T04:34:53.176928+0000","last_became_active":"2024-09-17T04:34:52.072796+0000","last_became_peered":"2024-09-17T04:34:52.072796+0000","last_unstale":"2024-09-17T04:34:53.176928+0000","last_undegraded":"2024-09-17T04:34:53.176928+0000","last_fullsized":"2024-09-17T04:34:53.176928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:53.971839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081155+0000","last_change":"2024-09-17T04:34:51.074170+0000","last_active":"2024-09-17T04:34:53.081155+0000","last_peered":"2024-09-17T04:34:53.081155+0000","last_clean":"2024-09-17T04:34:53.081155+0000","last_became_active":"2024-09-17T04:34:51.073836+0000","last_became_peered":"2024-09-17T04:34:51.073836+0000","last_unstale":"2024-09-17T04:34:53.081155+0000","last_undegraded":"2024-09-17T04:34:53.081155+0000","last_fullsized":"2024-09-17T04:34:53.081155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:30.884002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075826+0000","last_change":"2024-09-17T04:34:52.078331+0000","last_active":"2024-09-17T04:34:53.075826+0000","last_peered":"2024-09-17T04:34:53.075826+0000","last_clean":"2024-09-17T04:34:53.075826+0000","last_became_active":"2024-09-17T04:34:52.078012+0000","last_became_peered":"2024-09-17T04:34:52.078012+0000","last_unstale":"2024-09-17T04:34:53.075826+0000","last_undegraded":"2024-09-17T04:34:53.075826+0000","last_fullsized":"2024-09-17T04:34:53.075826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:28.961571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.078937+0000","last_change":"2024-09-17T04:34:51.077676+0000","last_active":"2024-09-17T04:34:53.078937+0000","last_peered":"2024-09-17T04:34:53.078937+0000","last_clean":"2024-09-17T04:34:53.078937+0000","last_became_active":"2024-09-17T04:34:51.076291+0000","last_became_peered":"2024-09-17T04:34:51.076291+0000","last_unstale":"2024-09-17T04:34:53.078937+0000","last_undegraded":"2024-09-17T04:34:53.078937+0000","last_fullsized":"2024-09-17T04:34:53.078937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:42.622688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081329+0000","last_change":"2024-09-17T04:34:52.075624+0000","last_active":"2024-09-17T04:34:53.081329+0000","last_peered":"2024-09-17T04:34:53.081329+0000","last_clean":"2024-09-17T04:34:53.081329+0000","last_became_active":"2024-09-17T04:34:52.074943+0000","last_became_peered":"2024-09-17T04:34:52.074943+0000","last_unstale":"2024-09-17T04:34:53.081329+0000","last_undegraded":"2024-09-17T04:34:53.081329+0000","last_fullsized":"2024-09-17T04:34:53.081329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:56.749605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081379+0000","last_change":"2024-09-17T04:34:51.077199+0000","last_active":"2024-09-17T04:34:53.081379+0000","last_peered":"2024-09-17T04:34:53.081379+0000","last_clean":"2024-09-17T04:34:53.081379+0000","last_became_active":"2024-09-17T04:34:51.076867+0000","last_became_peered":"2024-09-17T04:34:51.076867+0000","last_unstale":"2024-09-17T04:34:53.081379+0000","last_undegraded":"2024-09-17T04:34:53.081379+0000","last_fullsized":"2024-09-17T04:34:53.081379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:09.194133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315797+0000","last_change":"2024-09-17T04:34:52.083401+0000","last_active":"2024-09-17T04:34:53.315797+0000","last_peered":"2024-09-17T04:34:53.315797+0000","last_clean":"2024-09-17T04:34:53.315797+0000","last_became_active":"2024-09-17T04:34:52.083086+0000","last_became_peered":"2024-09-17T04:34:52.083086+0000","last_unstale":"2024-09-17T04:34:53.315797+0000","last_undegraded":"2024-09-17T04:34:53.315797+0000","last_fullsized":"2024-09-17T04:34:53.315797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.237945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076139+0000","last_change":"2024-09-17T04:34:51.070235+0000","last_active":"2024-09-17T04:34:53.076139+0000","last_peered":"2024-09-17T04:34:53.076139+0000","last_clean":"2024-09-17T04:34:53.076139+0000","last_became_active":"2024-09-17T04:34:51.069278+0000","last_became_peered":"2024-09-17T04:34:51.069278+0000","last_unstale":"2024-09-17T04:34:53.076139+0000","last_undegraded":"2024-09-17T04:34:53.076139+0000","last_fullsized":"2024-09-17T04:34:53.076139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:55.959278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318073+0000","last_change":"2024-09-17T04:34:52.076233+0000","last_active":"2024-09-17T04:34:53.318073+0000","last_peered":"2024-09-17T04:34:53.318073+0000","last_clean":"2024-09-17T04:34:53.318073+0000","last_became_active":"2024-09-17T04:34:52.075682+0000","last_became_peered":"2024-09-17T04:34:52.075682+0000","last_unstale":"2024-09-17T04:34:53.318073+0000","last_undegraded":"2024-09-17T04:34:53.318073+0000","last_fullsized":"2024-09-17T04:34:53.318073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:22.047574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080017+0000","last_change":"2024-09-17T04:34:51.076416+0000","last_active":"2024-09-17T04:34:53.080017+0000","last_peered":"2024-09-17T04:34:53.080017+0000","last_clean":"2024-09-17T04:34:53.080017+0000","last_became_active":"2024-09-17T04:34:51.076051+0000","last_became_peered":"2024-09-17T04:34:51.076051+0000","last_unstale":"2024-09-17T04:34:53.080017+0000","last_undegraded":"2024-09-17T04:34:53.080017+0000","last_fullsized":"2024-09-17T04:34:53.080017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:52.255204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079732+0000","last_change":"2024-09-17T04:34:52.086230+0000","last_active":"2024-09-17T04:34:53.079732+0000","last_peered":"2024-09-17T04:34:53.079732+0000","last_clean":"2024-09-17T04:34:53.079732+0000","last_became_active":"2024-09-17T04:34:52.085910+0000","last_became_peered":"2024-09-17T04:34:52.085910+0000","last_unstale":"2024-09-17T04:34:53.079732+0000","last_undegraded":"2024-09-17T04:34:53.079732+0000","last_fullsized":"2024-09-17T04:34:53.079732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:36.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315892+0000","last_change":"2024-09-17T04:34:51.075224+0000","last_active":"2024-09-17T04:34:53.315892+0000","last_peered":"2024-09-17T04:34:53.315892+0000","last_clean":"2024-09-17T04:34:53.315892+0000","last_became_active":"2024-09-17T04:34:51.074912+0000","last_became_peered":"2024-09-17T04:34:51.074912+0000","last_unstale":"2024-09-17T04:34:53.315892+0000","last_undegraded":"2024-09-17T04:34:53.315892+0000","last_fullsized":"2024-09-17T04:34:53.315892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:33.811243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315617+0000","last_change":"2024-09-17T04:34:52.085906+0000","last_active":"2024-09-17T04:34:53.315617+0000","last_peered":"2024-09-17T04:34:53.315617+0000","last_clean":"2024-09-17T04:34:53.315617+0000","last_became_active":"2024-09-17T04:34:52.085538+0000","last_became_peered":"2024-09-17T04:34:52.085538+0000","last_unstale":"2024-09-17T04:34:53.315617+0000","last_undegraded":"2024-09-17T04:34:53.315617+0000","last_fullsized":"2024-09-17T04:34:53.315617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:21.997395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081689+0000","last_change":"2024-09-17T04:34:51.074253+0000","last_active":"2024-09-17T04:34:53.081689+0000","last_peered":"2024-09-17T04:34:53.081689+0000","last_clean":"2024-09-17T04:34:53.081689+0000","last_became_active":"2024-09-17T04:34:51.073812+0000","last_became_peered":"2024-09-17T04:34:51.073812+0000","last_unstale":"2024-09-17T04:34:53.081689+0000","last_undegraded":"2024-09-17T04:34:53.081689+0000","last_fullsized":"2024-09-17T04:34:53.081689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:38.971561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081022+0000","last_change":"2024-09-17T04:34:52.082137+0000","last_active":"2024-09-17T04:34:53.081022+0000","last_peered":"2024-09-17T04:34:53.081022+0000","last_clean":"2024-09-17T04:34:53.081022+0000","last_became_active":"2024-09-17T04:34:52.081775+0000","last_became_peered":"2024-09-17T04:34:52.081775+0000","last_unstale":"2024-09-17T04:34:53.081022+0000","last_undegraded":"2024-09-17T04:34:53.081022+0000","last_fullsized":"2024-09-17T04:34:53.081022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:57.911822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080176+0000","last_change":"2024-09-17T04:34:51.077157+0000","last_active":"2024-09-17T04:34:53.080176+0000","last_peered":"2024-09-17T04:34:53.080176+0000","last_clean":"2024-09-17T04:34:53.080176+0000","last_became_active":"2024-09-17T04:34:51.076797+0000","last_became_peered":"2024-09-17T04:34:51.076797+0000","last_unstale":"2024-09-17T04:34:53.080176+0000","last_undegraded":"2024-09-17T04:34:53.080176+0000","last_fullsized":"2024-09-17T04:34:53.080176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:20.118978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079355+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:34:53.079355+0000","last_peered":"2024-09-17T04:34:53.079355+0000","last_clean":"2024-09-17T04:34:53.079355+0000","last_became_active":"2024-09-17T04:34:52.082118+0000","last_became_peered":"2024-09-17T04:34:52.082118+0000","last_unstale":"2024-09-17T04:34:53.079355+0000","last_undegraded":"2024-09-17T04:34:53.079355+0000","last_fullsized":"2024-09-17T04:34:53.079355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:44.752945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315385+0000","last_change":"2024-09-17T04:34:51.071083+0000","last_active":"2024-09-17T04:34:53.315385+0000","last_peered":"2024-09-17T04:34:53.315385+0000","last_clean":"2024-09-17T04:34:53.315385+0000","last_became_active":"2024-09-17T04:34:51.070733+0000","last_became_peered":"2024-09-17T04:34:51.070733+0000","last_unstale":"2024-09-17T04:34:53.315385+0000","last_undegraded":"2024-09-17T04:34:53.315385+0000","last_fullsized":"2024-09-17T04:34:53.315385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:36.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079638+0000","last_change":"2024-09-17T04:34:52.080277+0000","last_active":"2024-09-17T04:34:53.079638+0000","last_peered":"2024-09-17T04:34:53.079638+0000","last_clean":"2024-09-17T04:34:53.079638+0000","last_became_active":"2024-09-17T04:34:52.079969+0000","last_became_peered":"2024-09-17T04:34:52.079969+0000","last_unstale":"2024-09-17T04:34:53.079638+0000","last_undegraded":"2024-09-17T04:34:53.079638+0000","last_fullsized":"2024-09-17T04:34:53.079638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:10.360905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318123+0000","last_change":"2024-09-17T04:34:51.074800+0000","last_active":"2024-09-17T04:34:53.318123+0000","last_peered":"2024-09-17T04:34:53.318123+0000","last_clean":"2024-09-17T04:34:53.318123+0000","last_became_active":"2024-09-17T04:34:51.073287+0000","last_became_peered":"2024-09-17T04:34:51.073287+0000","last_unstale":"2024-09-17T04:34:53.318123+0000","last_undegraded":"2024-09-17T04:34:53.318123+0000","last_fullsized":"2024-09-17T04:34:53.318123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:19.933857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079619+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:34:53.079619+0000","last_peered":"2024-09-17T04:34:53.079619+0000","last_clean":"2024-09-17T04:34:53.079619+0000","last_became_active":"2024-09-17T04:34:52.082607+0000","last_became_peered":"2024-09-17T04:34:52.082607+0000","last_unstale":"2024-09-17T04:34:53.079619+0000","last_undegraded":"2024-09-17T04:34:53.079619+0000","last_fullsized":"2024-09-17T04:34:53.079619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:08.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.316047+0000","last_change":"2024-09-17T04:34:51.077171+0000","last_active":"2024-09-17T04:34:53.316047+0000","last_peered":"2024-09-17T04:34:53.316047+0000","last_clean":"2024-09-17T04:34:53.316047+0000","last_became_active":"2024-09-17T04:34:51.076780+0000","last_became_peered":"2024-09-17T04:34:51.076780+0000","last_unstale":"2024-09-17T04:34:53.316047+0000","last_undegraded":"2024-09-17T04:34:53.316047+0000","last_fullsized":"2024-09-17T04:34:53.316047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:40.031852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079942+0000","last_change":"2024-09-17T04:34:52.080032+0000","last_active":"2024-09-17T04:34:53.079942+0000","last_peered":"2024-09-17T04:34:53.079942+0000","last_clean":"2024-09-17T04:34:53.079942+0000","last_became_active":"2024-09-17T04:34:52.079536+0000","last_became_peered":"2024-09-17T04:34:52.079536+0000","last_unstale":"2024-09-17T04:34:53.079942+0000","last_undegraded":"2024-09-17T04:34:53.079942+0000","last_fullsized":"2024-09-17T04:34:53.079942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:55.220027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076248+0000","last_change":"2024-09-17T04:34:51.071053+0000","last_active":"2024-09-17T04:34:53.076248+0000","last_peered":"2024-09-17T04:34:53.076248+0000","last_clean":"2024-09-17T04:34:53.076248+0000","last_became_active":"2024-09-17T04:34:51.070673+0000","last_became_peered":"2024-09-17T04:34:51.070673+0000","last_unstale":"2024-09-17T04:34:53.076248+0000","last_undegraded":"2024-09-17T04:34:53.076248+0000","last_fullsized":"2024-09-17T04:34:53.076248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:31.660200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081894+0000","last_change":"2024-09-17T04:34:52.077963+0000","last_active":"2024-09-17T04:34:53.081894+0000","last_peered":"2024-09-17T04:34:53.081894+0000","last_clean":"2024-09-17T04:34:53.081894+0000","last_became_active":"2024-09-17T04:34:52.077499+0000","last_became_peered":"2024-09-17T04:34:52.077499+0000","last_unstale":"2024-09-17T04:34:53.081894+0000","last_undegraded":"2024-09-17T04:34:53.081894+0000","last_fullsized":"2024-09-17T04:34:53.081894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:25.309696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.316030+0000","last_change":"2024-09-17T04:34:51.070532+0000","last_active":"2024-09-17T04:34:53.316030+0000","last_peered":"2024-09-17T04:34:53.316030+0000","last_clean":"2024-09-17T04:34:53.316030+0000","last_became_active":"2024-09-17T04:34:51.070179+0000","last_became_peered":"2024-09-17T04:34:51.070179+0000","last_unstale":"2024-09-17T04:34:53.316030+0000","last_undegraded":"2024-09-17T04:34:53.316030+0000","last_fullsized":"2024-09-17T04:34:53.316030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:52.027096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079935+0000","last_change":"2024-09-17T04:34:52.083159+0000","last_active":"2024-09-17T04:34:53.079935+0000","last_peered":"2024-09-17T04:34:53.079935+0000","last_clean":"2024-09-17T04:34:53.079935+0000","last_became_active":"2024-09-17T04:34:52.082847+0000","last_became_peered":"2024-09-17T04:34:52.082847+0000","last_unstale":"2024-09-17T04:34:53.079935+0000","last_undegraded":"2024-09-17T04:34:53.079935+0000","last_fullsized":"2024-09-17T04:34:53.079935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:25.210506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080417+0000","last_change":"2024-09-17T04:34:41.975789+0000","last_active":"2024-09-17T04:34:53.080417+0000","last_peered":"2024-09-17T04:34:53.080417+0000","last_clean":"2024-09-17T04:34:53.080417+0000","last_became_active":"2024-09-17T04:34:41.974664+0000","last_became_peered":"2024-09-17T04:34:41.974664+0000","last_unstale":"2024-09-17T04:34:53.080417+0000","last_undegraded":"2024-09-17T04:34:53.080417+0000","last_fullsized":"2024-09-17T04:34:53.080417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_clean_scrub_stamp":"2024-09-17T04:34:39.702713+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:30.302931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080987+0000","last_change":"2024-09-17T04:34:51.068782+0000","last_active":"2024-09-17T04:34:53.080987+0000","last_peered":"2024-09-17T04:34:53.080987+0000","last_clean":"2024-09-17T04:34:53.080987+0000","last_became_active":"2024-09-17T04:34:51.068375+0000","last_became_peered":"2024-09-17T04:34:51.068375+0000","last_unstale":"2024-09-17T04:34:53.080987+0000","last_undegraded":"2024-09-17T04:34:53.080987+0000","last_fullsized":"2024-09-17T04:34:53.080987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:25.307166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177343+0000","last_change":"2024-09-17T04:34:52.086768+0000","last_active":"2024-09-17T04:34:53.177343+0000","last_peered":"2024-09-17T04:34:53.177343+0000","last_clean":"2024-09-17T04:34:53.177343+0000","last_became_active":"2024-09-17T04:34:52.086415+0000","last_became_peered":"2024-09-17T04:34:52.086415+0000","last_unstale":"2024-09-17T04:34:53.177343+0000","last_undegraded":"2024-09-17T04:34:53.177343+0000","last_fullsized":"2024-09-17T04:34:53.177343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:45.527873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080288+0000","last_change":"2024-09-17T04:34:51.075655+0000","last_active":"2024-09-17T04:34:53.080288+0000","last_peered":"2024-09-17T04:34:53.080288+0000","last_clean":"2024-09-17T04:34:53.080288+0000","last_became_active":"2024-09-17T04:34:51.075313+0000","last_became_peered":"2024-09-17T04:34:51.075313+0000","last_unstale":"2024-09-17T04:34:53.080288+0000","last_undegraded":"2024-09-17T04:34:53.080288+0000","last_fullsized":"2024-09-17T04:34:53.080288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:47.853850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315306+0000","last_change":"2024-09-17T04:34:52.080065+0000","last_active":"2024-09-17T04:34:53.315306+0000","last_peered":"2024-09-17T04:34:53.315306+0000","last_clean":"2024-09-17T04:34:53.315306+0000","last_became_active":"2024-09-17T04:34:52.079672+0000","last_became_peered":"2024-09-17T04:34:52.079672+0000","last_unstale":"2024-09-17T04:34:53.315306+0000","last_undegraded":"2024-09-17T04:34:53.315306+0000","last_fullsized":"2024-09-17T04:34:53.315306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:52.040153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315786+0000","last_change":"2024-09-17T04:34:51.075960+0000","last_active":"2024-09-17T04:34:53.315786+0000","last_peered":"2024-09-17T04:34:53.315786+0000","last_clean":"2024-09-17T04:34:53.315786+0000","last_became_active":"2024-09-17T04:34:51.075561+0000","last_became_peered":"2024-09-17T04:34:51.075561+0000","last_unstale":"2024-09-17T04:34:53.315786+0000","last_undegraded":"2024-09-17T04:34:53.315786+0000","last_fullsized":"2024-09-17T04:34:53.315786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:44.834618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075859+0000","last_change":"2024-09-17T04:34:52.070068+0000","last_active":"2024-09-17T04:34:53.075859+0000","last_peered":"2024-09-17T04:34:53.075859+0000","last_clean":"2024-09-17T04:34:53.075859+0000","last_became_active":"2024-09-17T04:34:52.069669+0000","last_became_peered":"2024-09-17T04:34:52.069669+0000","last_unstale":"2024-09-17T04:34:53.075859+0000","last_undegraded":"2024-09-17T04:34:53.075859+0000","last_fullsized":"2024-09-17T04:34:53.075859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:39.617045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081829+0000","last_change":"2024-09-17T04:34:51.070187+0000","last_active":"2024-09-17T04:34:53.081829+0000","last_peered":"2024-09-17T04:34:53.081829+0000","last_clean":"2024-09-17T04:34:53.081829+0000","last_became_active":"2024-09-17T04:34:51.069714+0000","last_became_peered":"2024-09-17T04:34:51.069714+0000","last_unstale":"2024-09-17T04:34:53.081829+0000","last_undegraded":"2024-09-17T04:34:53.081829+0000","last_fullsized":"2024-09-17T04:34:53.081829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:28.082690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318145+0000","last_change":"2024-09-17T04:34:52.069653+0000","last_active":"2024-09-17T04:34:53.318145+0000","last_peered":"2024-09-17T04:34:53.318145+0000","last_clean":"2024-09-17T04:34:53.318145+0000","last_became_active":"2024-09-17T04:34:52.069282+0000","last_became_peered":"2024-09-17T04:34:52.069282+0000","last_unstale":"2024-09-17T04:34:53.318145+0000","last_undegraded":"2024-09-17T04:34:53.318145+0000","last_fullsized":"2024-09-17T04:34:53.318145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:40.828725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076208+0000","last_change":"2024-09-17T04:34:51.070676+0000","last_active":"2024-09-17T04:34:53.076208+0000","last_peered":"2024-09-17T04:34:53.076208+0000","last_clean":"2024-09-17T04:34:53.076208+0000","last_became_active":"2024-09-17T04:34:51.069006+0000","last_became_peered":"2024-09-17T04:34:51.069006+0000","last_unstale":"2024-09-17T04:34:53.076208+0000","last_undegraded":"2024-09-17T04:34:53.076208+0000","last_fullsized":"2024-09-17T04:34:53.076208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:45.452865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081804+0000","last_change":"2024-09-17T04:34:52.087131+0000","last_active":"2024-09-17T04:34:53.081804+0000","last_peered":"2024-09-17T04:34:53.081804+0000","last_clean":"2024-09-17T04:34:53.081804+0000","last_became_active":"2024-09-17T04:34:52.086782+0000","last_became_peered":"2024-09-17T04:34:52.086782+0000","last_unstale":"2024-09-17T04:34:53.081804+0000","last_undegraded":"2024-09-17T04:34:53.081804+0000","last_fullsized":"2024-09-17T04:34:53.081804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:53.987579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080352+0000","last_change":"2024-09-17T04:34:51.068708+0000","last_active":"2024-09-17T04:34:53.080352+0000","last_peered":"2024-09-17T04:34:53.080352+0000","last_clean":"2024-09-17T04:34:53.080352+0000","last_became_active":"2024-09-17T04:34:51.068354+0000","last_became_peered":"2024-09-17T04:34:51.068354+0000","last_unstale":"2024-09-17T04:34:53.080352+0000","last_undegraded":"2024-09-17T04:34:53.080352+0000","last_fullsized":"2024-09-17T04:34:53.080352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:04.219898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076122+0000","last_change":"2024-09-17T04:34:52.071586+0000","last_active":"2024-09-17T04:34:53.076122+0000","last_peered":"2024-09-17T04:34:53.076122+0000","last_clean":"2024-09-17T04:34:53.076122+0000","last_became_active":"2024-09-17T04:34:52.071246+0000","last_became_peered":"2024-09-17T04:34:52.071246+0000","last_unstale":"2024-09-17T04:34:53.076122+0000","last_undegraded":"2024-09-17T04:34:53.076122+0000","last_fullsized":"2024-09-17T04:34:53.076122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:03.620107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076048+0000","last_change":"2024-09-17T04:34:51.078947+0000","last_active":"2024-09-17T04:34:53.076048+0000","last_peered":"2024-09-17T04:34:53.076048+0000","last_clean":"2024-09-17T04:34:53.076048+0000","last_became_active":"2024-09-17T04:34:51.078557+0000","last_became_peered":"2024-09-17T04:34:51.078557+0000","last_unstale":"2024-09-17T04:34:53.076048+0000","last_undegraded":"2024-09-17T04:34:53.076048+0000","last_fullsized":"2024-09-17T04:34:53.076048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:51.413772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177384+0000","last_change":"2024-09-17T04:34:52.086372+0000","last_active":"2024-09-17T04:34:53.177384+0000","last_peered":"2024-09-17T04:34:53.177384+0000","last_clean":"2024-09-17T04:34:53.177384+0000","last_became_active":"2024-09-17T04:34:52.086018+0000","last_became_peered":"2024-09-17T04:34:52.086018+0000","last_unstale":"2024-09-17T04:34:53.177384+0000","last_undegraded":"2024-09-17T04:34:53.177384+0000","last_fullsized":"2024-09-17T04:34:53.177384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:10.818503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079074+0000","last_change":"2024-09-17T04:34:51.076427+0000","last_active":"2024-09-17T04:34:53.079074+0000","last_peered":"2024-09-17T04:34:53.079074+0000","last_clean":"2024-09-17T04:34:53.079074+0000","last_became_active":"2024-09-17T04:34:51.075881+0000","last_became_peered":"2024-09-17T04:34:51.075881+0000","last_unstale":"2024-09-17T04:34:53.079074+0000","last_undegraded":"2024-09-17T04:34:53.079074+0000","last_fullsized":"2024-09-17T04:34:53.079074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:40.903989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315468+0000","last_change":"2024-09-17T04:34:52.076358+0000","last_active":"2024-09-17T04:34:53.315468+0000","last_peered":"2024-09-17T04:34:53.315468+0000","last_clean":"2024-09-17T04:34:53.315468+0000","last_became_active":"2024-09-17T04:34:52.076035+0000","last_became_peered":"2024-09-17T04:34:52.076035+0000","last_unstale":"2024-09-17T04:34:53.315468+0000","last_undegraded":"2024-09-17T04:34:53.315468+0000","last_fullsized":"2024-09-17T04:34:53.315468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:30.660617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080167+0000","last_change":"2024-09-17T04:34:51.072737+0000","last_active":"2024-09-17T04:34:53.080167+0000","last_peered":"2024-09-17T04:34:53.080167+0000","last_clean":"2024-09-17T04:34:53.080167+0000","last_became_active":"2024-09-17T04:34:51.072378+0000","last_became_peered":"2024-09-17T04:34:51.072378+0000","last_unstale":"2024-09-17T04:34:53.080167+0000","last_undegraded":"2024-09-17T04:34:53.080167+0000","last_fullsized":"2024-09-17T04:34:53.080167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:27.364636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318181+0000","last_change":"2024-09-17T04:34:52.068446+0000","last_active":"2024-09-17T04:34:53.318181+0000","last_peered":"2024-09-17T04:34:53.318181+0000","last_clean":"2024-09-17T04:34:53.318181+0000","last_became_active":"2024-09-17T04:34:52.068047+0000","last_became_peered":"2024-09-17T04:34:52.068047+0000","last_unstale":"2024-09-17T04:34:53.318181+0000","last_undegraded":"2024-09-17T04:34:53.318181+0000","last_fullsized":"2024-09-17T04:34:53.318181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:26.994189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075960+0000","last_change":"2024-09-17T04:34:51.069539+0000","last_active":"2024-09-17T04:34:53.075960+0000","last_peered":"2024-09-17T04:34:53.075960+0000","last_clean":"2024-09-17T04:34:53.075960+0000","last_became_active":"2024-09-17T04:34:51.067438+0000","last_became_peered":"2024-09-17T04:34:51.067438+0000","last_unstale":"2024-09-17T04:34:53.075960+0000","last_undegraded":"2024-09-17T04:34:53.075960+0000","last_fullsized":"2024-09-17T04:34:53.075960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:13.078391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177144+0000","last_change":"2024-09-17T04:34:52.078035+0000","last_active":"2024-09-17T04:34:53.177144+0000","last_peered":"2024-09-17T04:34:53.177144+0000","last_clean":"2024-09-17T04:34:53.177144+0000","last_became_active":"2024-09-17T04:34:52.077708+0000","last_became_peered":"2024-09-17T04:34:52.077708+0000","last_unstale":"2024-09-17T04:34:53.177144+0000","last_undegraded":"2024-09-17T04:34:53.177144+0000","last_fullsized":"2024-09-17T04:34:53.177144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:00.313209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076024+0000","last_change":"2024-09-17T04:34:51.074749+0000","last_active":"2024-09-17T04:34:53.076024+0000","last_peered":"2024-09-17T04:34:53.076024+0000","last_clean":"2024-09-17T04:34:53.076024+0000","last_became_active":"2024-09-17T04:34:51.074393+0000","last_became_peered":"2024-09-17T04:34:51.074393+0000","last_unstale":"2024-09-17T04:34:53.076024+0000","last_undegraded":"2024-09-17T04:34:53.076024+0000","last_fullsized":"2024-09-17T04:34:53.076024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:39.558815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177339+0000","last_change":"2024-09-17T04:34:52.075585+0000","last_active":"2024-09-17T04:34:53.177339+0000","last_peered":"2024-09-17T04:34:53.177339+0000","last_clean":"2024-09-17T04:34:53.177339+0000","last_became_active":"2024-09-17T04:34:52.075257+0000","last_became_peered":"2024-09-17T04:34:52.075257+0000","last_unstale":"2024-09-17T04:34:53.177339+0000","last_undegraded":"2024-09-17T04:34:53.177339+0000","last_fullsized":"2024-09-17T04:34:53.177339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:38.029256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080942+0000","last_change":"2024-09-17T04:34:51.071324+0000","last_active":"2024-09-17T04:34:53.080942+0000","last_peered":"2024-09-17T04:34:53.080942+0000","last_clean":"2024-09-17T04:34:53.080942+0000","last_became_active":"2024-09-17T04:34:51.070944+0000","last_became_peered":"2024-09-17T04:34:51.070944+0000","last_unstale":"2024-09-17T04:34:53.080942+0000","last_undegraded":"2024-09-17T04:34:53.080942+0000","last_fullsized":"2024-09-17T04:34:53.080942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:13.931324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079005+0000","last_change":"2024-09-17T04:34:52.081178+0000","last_active":"2024-09-17T04:34:53.079005+0000","last_peered":"2024-09-17T04:34:53.079005+0000","last_clean":"2024-09-17T04:34:53.079005+0000","last_became_active":"2024-09-17T04:34:52.080855+0000","last_became_peered":"2024-09-17T04:34:52.080855+0000","last_unstale":"2024-09-17T04:34:53.079005+0000","last_undegraded":"2024-09-17T04:34:53.079005+0000","last_fullsized":"2024-09-17T04:34:53.079005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:49.091080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081719+0000","last_change":"2024-09-17T04:34:52.066633+0000","last_active":"2024-09-17T04:34:53.081719+0000","last_peered":"2024-09-17T04:34:53.081719+0000","last_clean":"2024-09-17T04:34:53.081719+0000","last_became_active":"2024-09-17T04:34:52.066263+0000","last_became_peered":"2024-09-17T04:34:52.066263+0000","last_unstale":"2024-09-17T04:34:53.081719+0000","last_undegraded":"2024-09-17T04:34:53.081719+0000","last_fullsized":"2024-09-17T04:34:53.081719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:13.396220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079366+0000","last_change":"2024-09-17T04:34:51.067927+0000","last_active":"2024-09-17T04:34:53.079366+0000","last_peered":"2024-09-17T04:34:53.079366+0000","last_clean":"2024-09-17T04:34:53.079366+0000","last_became_active":"2024-09-17T04:34:51.067555+0000","last_became_peered":"2024-09-17T04:34:51.067555+0000","last_unstale":"2024-09-17T04:34:53.079366+0000","last_undegraded":"2024-09-17T04:34:53.079366+0000","last_fullsized":"2024-09-17T04:34:53.079366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:33.815585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081560+0000","last_change":"2024-09-17T04:34:52.074529+0000","last_active":"2024-09-17T04:34:53.081560+0000","last_peered":"2024-09-17T04:34:53.081560+0000","last_clean":"2024-09-17T04:34:53.081560+0000","last_became_active":"2024-09-17T04:34:52.074149+0000","last_became_peered":"2024-09-17T04:34:52.074149+0000","last_unstale":"2024-09-17T04:34:53.081560+0000","last_undegraded":"2024-09-17T04:34:53.081560+0000","last_fullsized":"2024-09-17T04:34:53.081560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:31.679908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079953+0000","last_change":"2024-09-17T04:34:51.078231+0000","last_active":"2024-09-17T04:34:53.079953+0000","last_peered":"2024-09-17T04:34:53.079953+0000","last_clean":"2024-09-17T04:34:53.079953+0000","last_became_active":"2024-09-17T04:34:51.077872+0000","last_became_peered":"2024-09-17T04:34:51.077872+0000","last_unstale":"2024-09-17T04:34:53.079953+0000","last_undegraded":"2024-09-17T04:34:53.079953+0000","last_fullsized":"2024-09-17T04:34:53.079953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:38.304333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315510+0000","last_change":"2024-09-17T04:34:52.084955+0000","last_active":"2024-09-17T04:34:53.315510+0000","last_peered":"2024-09-17T04:34:53.315510+0000","last_clean":"2024-09-17T04:34:53.315510+0000","last_became_active":"2024-09-17T04:34:52.084559+0000","last_became_peered":"2024-09-17T04:34:52.084559+0000","last_unstale":"2024-09-17T04:34:53.315510+0000","last_undegraded":"2024-09-17T04:34:53.315510+0000","last_fullsized":"2024-09-17T04:34:53.315510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:28.901357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177427+0000","last_change":"2024-09-17T04:34:51.073959+0000","last_active":"2024-09-17T04:34:53.177427+0000","last_peered":"2024-09-17T04:34:53.177427+0000","last_clean":"2024-09-17T04:34:53.177427+0000","last_became_active":"2024-09-17T04:34:51.073496+0000","last_became_peered":"2024-09-17T04:34:51.073496+0000","last_unstale":"2024-09-17T04:34:53.177427+0000","last_undegraded":"2024-09-17T04:34:53.177427+0000","last_fullsized":"2024-09-17T04:34:53.177427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:23.001571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177328+0000","last_change":"2024-09-17T04:34:52.081971+0000","last_active":"2024-09-17T04:34:53.177328+0000","last_peered":"2024-09-17T04:34:53.177328+0000","last_clean":"2024-09-17T04:34:53.177328+0000","last_became_active":"2024-09-17T04:34:52.081259+0000","last_became_peered":"2024-09-17T04:34:52.081259+0000","last_unstale":"2024-09-17T04:34:53.177328+0000","last_undegraded":"2024-09-17T04:34:53.177328+0000","last_fullsized":"2024-09-17T04:34:53.177328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:43.915741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315763+0000","last_change":"2024-09-17T04:34:51.070142+0000","last_active":"2024-09-17T04:34:53.315763+0000","last_peered":"2024-09-17T04:34:53.315763+0000","last_clean":"2024-09-17T04:34:53.315763+0000","last_became_active":"2024-09-17T04:34:51.069777+0000","last_became_peered":"2024-09-17T04:34:51.069777+0000","last_unstale":"2024-09-17T04:34:53.315763+0000","last_undegraded":"2024-09-17T04:34:53.315763+0000","last_fullsized":"2024-09-17T04:34:53.315763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:51.718064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476742,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":666914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":76546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476742,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":76546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476742,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":76546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":217088,"data_stored":76546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":217088,"data_stored":76546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":76546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":811008,"data_stored":666914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:34:58.142 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:34:58.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.294+0000 7f1cd00d5640 1 -- 172.21.15.43:0/55701401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc80c6f00 msgr2=0x7f1cc80d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:58.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.294+0000 7f1cd00d5640 1 --2- 172.21.15.43:0/55701401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc80c6f00 0x7f1cc80d15a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1cc808e520 tx=0x7f1cc402a560 comp rx=0 tx=0).stop 2024-09-17T04:34:58.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.294+0000 7f1cd00d5640 1 -- 172.21.15.43:0/55701401 shutdown_connections 2024-09-17T04:34:58.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.294+0000 7f1cd00d5640 1 --2- 172.21.15.43:0/55701401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1cc80c69b0 0x7f1cc815eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.294+0000 7f1cd00d5640 1 --2- 172.21.15.43:0/55701401 >> v2:172.21.15.62:3300/0 conn(0x7f1cc8155d40 0x7f1cc80d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.294+0000 7f1cd00d5640 1 --2- 172.21.15.43:0/55701401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc80c6f00 0x7f1cc80d15a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.294+0000 7f1cd00d5640 1 -- 172.21.15.43:0/55701401 >> 172.21.15.43:0/55701401 conn(0x7f1cc806f460 msgr2=0x7f1cc806f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.294+0000 7f1cd00d5640 1 -- 172.21.15.43:0/55701401 shutdown_connections 2024-09-17T04:34:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.294+0000 7f1cd00d5640 1 -- 172.21.15.43:0/55701401 wait complete. 2024-09-17T04:34:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.296+0000 7f1cd00d5640 1 Processor -- start 2024-09-17T04:34:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.296+0000 7f1cd00d5640 1 -- start start 2024-09-17T04:34:58.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.297+0000 7f1cd00d5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1cc80c69b0 0x7f1cc8153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:58.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.297+0000 7f1cd00d5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc80c6f00 0x7f1cc81f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:58.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.297+0000 7f1cd00d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cc8155d40 0x7f1cc81513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:58.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.297+0000 7f1cd00d5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc80c7730 con 0x7f1cc80c6f00 2024-09-17T04:34:58.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.297+0000 7f1cd00d5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc80c7450 con 0x7f1cc8155d40 2024-09-17T04:34:58.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.297+0000 7f1cd00d5640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1cc80b4d50 con 0x7f1cc80c69b0 2024-09-17T04:34:58.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.297+0000 7f1ccd670640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc80c6f00 0x7f1cc81f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:58.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.297+0000 7f1ccd670640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc80c6f00 0x7f1cc81f5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41622/0 (socket says 172.21.15.43:41622) 2024-09-17T04:34:58.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.297+0000 7f1ccd670640 1 -- 172.21.15.43:0/2633782522 learned_addr learned my addr 172.21.15.43:0/2633782522 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:58.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.297+0000 7f1ccde71640 1 --2- 172.21.15.43:0/2633782522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1cc80c69b0 0x7f1cc8153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:58.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.297+0000 7f1cce672640 1 --2- 172.21.15.43:0/2633782522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cc8155d40 0x7f1cc81513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:58.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.297+0000 7f1ccd670640 1 -- 172.21.15.43:0/2633782522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1cc80c69b0 msgr2=0x7f1cc8153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:58.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.297+0000 7f1ccd670640 1 --2- 172.21.15.43:0/2633782522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1cc80c69b0 0x7f1cc8153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.298+0000 7f1ccd670640 1 -- 172.21.15.43:0/2633782522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cc8155d40 msgr2=0x7f1cc81513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:58.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.298+0000 7f1ccd670640 1 --2- 172.21.15.43:0/2633782522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cc8155d40 0x7f1cc81513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.298+0000 7f1ccd670640 1 -- 172.21.15.43:0/2633782522 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc81f6290 con 0x7f1cc80c6f00 2024-09-17T04:34:58.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.298+0000 7f1ccd670640 1 --2- 172.21.15.43:0/2633782522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc80c6f00 0x7f1cc81f5d50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800d740 tx=0x7f1cb800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:58.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.298+0000 7f1cbe7fc640 1 -- 172.21.15.43:0/2633782522 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8017070 con 0x7f1cc80c6f00 2024-09-17T04:34:58.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.298+0000 7f1cbe7fc640 1 -- 172.21.15.43:0/2633782522 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cb8009d20 con 0x7f1cc80c6f00 2024-09-17T04:34:58.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.298+0000 7f1cd00d5640 1 -- 172.21.15.43:0/2633782522 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc815d090 con 0x7f1cc80c6f00 2024-09-17T04:34:58.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.298+0000 7f1cbe7fc640 1 -- 172.21.15.43:0/2633782522 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80106c0 con 0x7f1cc80c6f00 2024-09-17T04:34:58.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.298+0000 7f1cd00d5640 1 -- 172.21.15.43:0/2633782522 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc81f3070 con 0x7f1cc80c6f00 2024-09-17T04:34:58.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.299+0000 7f1cd00d5640 1 -- 172.21.15.43:0/2633782522 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cc80b5ca0 con 0x7f1cc80c6f00 2024-09-17T04:34:58.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.300+0000 7f1cbe7fc640 1 -- 172.21.15.43:0/2633782522 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1cb801a070 con 0x7f1cc80c6f00 2024-09-17T04:34:58.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.300+0000 7f1cbe7fc640 1 --2- 172.21.15.43:0/2633782522 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1cac078bc0 0x7f1cac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:58.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.300+0000 7f1cbe7fc640 1 -- 172.21.15.43:0/2633782522 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1cb809b1f0 con 0x7f1cc80c6f00 2024-09-17T04:34:58.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.301+0000 7f1ccde71640 1 --2- 172.21.15.43:0/2633782522 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1cac078bc0 0x7f1cac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:58.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.301+0000 7f1ccde71640 1 --2- 172.21.15.43:0/2633782522 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1cac078bc0 0x7f1cac07b0d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4033000 tx=0x7f1cc4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:58.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.304+0000 7f1cbe7fc640 1 -- 172.21.15.43:0/2633782522 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1cc80b5ca0 con 0x7f1cc80c6f00 2024-09-17T04:34:58.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.486+0000 7f1cd00d5640 1 -- 172.21.15.43:0/2633782522 --> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1cc815d350 con 0x7f1cac078bc0 2024-09-17T04:34:58.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.491+0000 7f1cbe7fc640 1 -- 172.21.15.43:0/2633782522 <== mgr.4100 v2:172.21.15.62:6800/1186143747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7f1cc815d350 con 0x7f1cac078bc0 2024-09-17T04:34:58.494 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:34:58.495 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-17T04:34:58.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.494+0000 7f1cd00d5640 1 -- 172.21.15.43:0/2633782522 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1cac078bc0 msgr2=0x7f1cac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:58.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.494+0000 7f1cd00d5640 1 --2- 172.21.15.43:0/2633782522 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1cac078bc0 0x7f1cac07b0d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4033000 tx=0x7f1cc4004730 comp rx=0 tx=0).stop 2024-09-17T04:34:58.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.494+0000 7f1cd00d5640 1 -- 172.21.15.43:0/2633782522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc80c6f00 msgr2=0x7f1cc81f5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:58.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.494+0000 7f1cd00d5640 1 --2- 172.21.15.43:0/2633782522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc80c6f00 0x7f1cc81f5d50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800d740 tx=0x7f1cb800dc00 comp rx=0 tx=0).stop 2024-09-17T04:34:58.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.494+0000 7f1cd00d5640 1 -- 172.21.15.43:0/2633782522 shutdown_connections 2024-09-17T04:34:58.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.494+0000 7f1cd00d5640 1 --2- 172.21.15.43:0/2633782522 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1cac078bc0 0x7f1cac07b0d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.494+0000 7f1cd00d5640 1 --2- 172.21.15.43:0/2633782522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cc8155d40 0x7f1cc81513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.494+0000 7f1cd00d5640 1 --2- 172.21.15.43:0/2633782522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc80c6f00 0x7f1cc81f5d50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.494+0000 7f1cd00d5640 1 --2- 172.21.15.43:0/2633782522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1cc80c69b0 0x7f1cc8153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.494+0000 7f1cd00d5640 1 -- 172.21.15.43:0/2633782522 >> 172.21.15.43:0/2633782522 conn(0x7f1cc806f460 msgr2=0x7f1cc815aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:58.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.494+0000 7f1cd00d5640 1 -- 172.21.15.43:0/2633782522 shutdown_connections 2024-09-17T04:34:58.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.494+0000 7f1cd00d5640 1 -- 172.21.15.43:0/2633782522 wait complete. 2024-09-17T04:34:58.505 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-17T04:34:56.890674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239916,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734804,"statfs":{"total":773094113280,"available":772848439296,"internally_reserved":0,"allocated":2924544,"data_stored":1793104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001567"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079958+0000","last_change":"2024-09-17T04:34:52.082794+0000","last_active":"2024-09-17T04:34:53.079958+0000","last_peered":"2024-09-17T04:34:53.079958+0000","last_clean":"2024-09-17T04:34:53.079958+0000","last_became_active":"2024-09-17T04:34:52.081216+0000","last_became_peered":"2024-09-17T04:34:52.081216+0000","last_unstale":"2024-09-17T04:34:53.079958+0000","last_undegraded":"2024-09-17T04:34:53.079958+0000","last_fullsized":"2024-09-17T04:34:53.079958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:32.229667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075998+0000","last_change":"2024-09-17T04:34:52.071762+0000","last_active":"2024-09-17T04:34:53.075998+0000","last_peered":"2024-09-17T04:34:53.075998+0000","last_clean":"2024-09-17T04:34:53.075998+0000","last_became_active":"2024-09-17T04:34:52.071488+0000","last_became_peered":"2024-09-17T04:34:52.071488+0000","last_unstale":"2024-09-17T04:34:53.075998+0000","last_undegraded":"2024-09-17T04:34:53.075998+0000","last_fullsized":"2024-09-17T04:34:53.075998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:00.729921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315645+0000","last_change":"2024-09-17T04:34:52.073360+0000","last_active":"2024-09-17T04:34:53.315645+0000","last_peered":"2024-09-17T04:34:53.315645+0000","last_clean":"2024-09-17T04:34:53.315645+0000","last_became_active":"2024-09-17T04:34:52.073014+0000","last_became_peered":"2024-09-17T04:34:52.073014+0000","last_unstale":"2024-09-17T04:34:53.315645+0000","last_undegraded":"2024-09-17T04:34:53.315645+0000","last_fullsized":"2024-09-17T04:34:53.315645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:14.331608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081622+0000","last_change":"2024-09-17T04:34:52.077679+0000","last_active":"2024-09-17T04:34:53.081622+0000","last_peered":"2024-09-17T04:34:53.081622+0000","last_clean":"2024-09-17T04:34:53.081622+0000","last_became_active":"2024-09-17T04:34:52.077306+0000","last_became_peered":"2024-09-17T04:34:52.077306+0000","last_unstale":"2024-09-17T04:34:53.081622+0000","last_undegraded":"2024-09-17T04:34:53.081622+0000","last_fullsized":"2024-09-17T04:34:53.081622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:44.967159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080748+0000","last_change":"2024-09-17T04:34:52.075036+0000","last_active":"2024-09-17T04:34:53.080748+0000","last_peered":"2024-09-17T04:34:53.080748+0000","last_clean":"2024-09-17T04:34:53.080748+0000","last_became_active":"2024-09-17T04:34:52.074649+0000","last_became_peered":"2024-09-17T04:34:52.074649+0000","last_unstale":"2024-09-17T04:34:53.080748+0000","last_undegraded":"2024-09-17T04:34:53.080748+0000","last_fullsized":"2024-09-17T04:34:53.080748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:22.293746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081410+0000","last_change":"2024-09-17T04:34:52.081059+0000","last_active":"2024-09-17T04:34:53.081410+0000","last_peered":"2024-09-17T04:34:53.081410+0000","last_clean":"2024-09-17T04:34:53.081410+0000","last_became_active":"2024-09-17T04:34:52.080677+0000","last_became_peered":"2024-09-17T04:34:52.080677+0000","last_unstale":"2024-09-17T04:34:53.081410+0000","last_undegraded":"2024-09-17T04:34:53.081410+0000","last_fullsized":"2024-09-17T04:34:53.081410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:52.404672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079328+0000","last_change":"2024-09-17T04:34:52.071135+0000","last_active":"2024-09-17T04:34:53.079328+0000","last_peered":"2024-09-17T04:34:53.079328+0000","last_clean":"2024-09-17T04:34:53.079328+0000","last_became_active":"2024-09-17T04:34:52.070844+0000","last_became_peered":"2024-09-17T04:34:52.070844+0000","last_unstale":"2024-09-17T04:34:53.079328+0000","last_undegraded":"2024-09-17T04:34:53.079328+0000","last_fullsized":"2024-09-17T04:34:53.079328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:02.373675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176836+0000","last_change":"2024-09-17T04:34:52.083343+0000","last_active":"2024-09-17T04:34:53.176836+0000","last_peered":"2024-09-17T04:34:53.176836+0000","last_clean":"2024-09-17T04:34:53.176836+0000","last_became_active":"2024-09-17T04:34:52.083008+0000","last_became_peered":"2024-09-17T04:34:52.083008+0000","last_unstale":"2024-09-17T04:34:53.176836+0000","last_undegraded":"2024-09-17T04:34:53.176836+0000","last_fullsized":"2024-09-17T04:34:53.176836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:02.710077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079639+0000","last_change":"2024-09-17T04:34:52.083331+0000","last_active":"2024-09-17T04:34:53.079639+0000","last_peered":"2024-09-17T04:34:53.079639+0000","last_clean":"2024-09-17T04:34:53.079639+0000","last_became_active":"2024-09-17T04:34:52.082984+0000","last_became_peered":"2024-09-17T04:34:52.082984+0000","last_unstale":"2024-09-17T04:34:53.079639+0000","last_undegraded":"2024-09-17T04:34:53.079639+0000","last_fullsized":"2024-09-17T04:34:53.079639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:56.779776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080623+0000","last_change":"2024-09-17T04:34:52.087207+0000","last_active":"2024-09-17T04:34:53.080623+0000","last_peered":"2024-09-17T04:34:53.080623+0000","last_clean":"2024-09-17T04:34:53.080623+0000","last_became_active":"2024-09-17T04:34:52.086885+0000","last_became_peered":"2024-09-17T04:34:52.086885+0000","last_unstale":"2024-09-17T04:34:53.080623+0000","last_undegraded":"2024-09-17T04:34:53.080623+0000","last_fullsized":"2024-09-17T04:34:53.080623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:52.121338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.078802+0000","last_change":"2024-09-17T04:34:52.086309+0000","last_active":"2024-09-17T04:34:53.078802+0000","last_peered":"2024-09-17T04:34:53.078802+0000","last_clean":"2024-09-17T04:34:53.078802+0000","last_became_active":"2024-09-17T04:34:52.085996+0000","last_became_peered":"2024-09-17T04:34:52.085996+0000","last_unstale":"2024-09-17T04:34:53.078802+0000","last_undegraded":"2024-09-17T04:34:53.078802+0000","last_fullsized":"2024-09-17T04:34:53.078802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:58.004980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318081+0000","last_change":"2024-09-17T04:34:52.077080+0000","last_active":"2024-09-17T04:34:53.318081+0000","last_peered":"2024-09-17T04:34:53.318081+0000","last_clean":"2024-09-17T04:34:53.318081+0000","last_became_active":"2024-09-17T04:34:52.076756+0000","last_became_peered":"2024-09-17T04:34:52.076756+0000","last_unstale":"2024-09-17T04:34:53.318081+0000","last_undegraded":"2024-09-17T04:34:53.318081+0000","last_fullsized":"2024-09-17T04:34:53.318081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:48.044400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177180+0000","last_change":"2024-09-17T04:34:52.076609+0000","last_active":"2024-09-17T04:34:53.177180+0000","last_peered":"2024-09-17T04:34:53.177180+0000","last_clean":"2024-09-17T04:34:53.177180+0000","last_became_active":"2024-09-17T04:34:52.076277+0000","last_became_peered":"2024-09-17T04:34:52.076277+0000","last_unstale":"2024-09-17T04:34:53.177180+0000","last_undegraded":"2024-09-17T04:34:53.177180+0000","last_fullsized":"2024-09-17T04:34:53.177180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:28.537566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315331+0000","last_change":"2024-09-17T04:34:52.076754+0000","last_active":"2024-09-17T04:34:53.315331+0000","last_peered":"2024-09-17T04:34:53.315331+0000","last_clean":"2024-09-17T04:34:53.315331+0000","last_became_active":"2024-09-17T04:34:52.076261+0000","last_became_peered":"2024-09-17T04:34:52.076261+0000","last_unstale":"2024-09-17T04:34:53.315331+0000","last_undegraded":"2024-09-17T04:34:53.315331+0000","last_fullsized":"2024-09-17T04:34:53.315331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:51.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075849+0000","last_change":"2024-09-17T04:34:52.079161+0000","last_active":"2024-09-17T04:34:53.075849+0000","last_peered":"2024-09-17T04:34:53.075849+0000","last_clean":"2024-09-17T04:34:53.075849+0000","last_became_active":"2024-09-17T04:34:52.078782+0000","last_became_peered":"2024-09-17T04:34:52.078782+0000","last_unstale":"2024-09-17T04:34:53.075849+0000","last_undegraded":"2024-09-17T04:34:53.075849+0000","last_fullsized":"2024-09-17T04:34:53.075849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:06.894137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080646+0000","last_change":"2024-09-17T04:34:52.070767+0000","last_active":"2024-09-17T04:34:53.080646+0000","last_peered":"2024-09-17T04:34:53.080646+0000","last_clean":"2024-09-17T04:34:53.080646+0000","last_became_active":"2024-09-17T04:34:52.070428+0000","last_became_peered":"2024-09-17T04:34:52.070428+0000","last_unstale":"2024-09-17T04:34:53.080646+0000","last_undegraded":"2024-09-17T04:34:53.080646+0000","last_fullsized":"2024-09-17T04:34:53.080646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:42.820391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.082014+0000","last_change":"2024-09-17T04:34:52.077238+0000","last_active":"2024-09-17T04:34:53.082014+0000","last_peered":"2024-09-17T04:34:53.082014+0000","last_clean":"2024-09-17T04:34:53.082014+0000","last_became_active":"2024-09-17T04:34:52.076897+0000","last_became_peered":"2024-09-17T04:34:52.076897+0000","last_unstale":"2024-09-17T04:34:53.082014+0000","last_undegraded":"2024-09-17T04:34:53.082014+0000","last_fullsized":"2024-09-17T04:34:53.082014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:27.431184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.316114+0000","last_change":"2024-09-17T04:34:52.080917+0000","last_active":"2024-09-17T04:34:53.316114+0000","last_peered":"2024-09-17T04:34:53.316114+0000","last_clean":"2024-09-17T04:34:53.316114+0000","last_became_active":"2024-09-17T04:34:52.080597+0000","last_became_peered":"2024-09-17T04:34:52.080597+0000","last_unstale":"2024-09-17T04:34:53.316114+0000","last_undegraded":"2024-09-17T04:34:53.316114+0000","last_fullsized":"2024-09-17T04:34:53.316114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:10.560075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080159+0000","last_change":"2024-09-17T04:34:52.077284+0000","last_active":"2024-09-17T04:34:53.080159+0000","last_peered":"2024-09-17T04:34:53.080159+0000","last_clean":"2024-09-17T04:34:53.080159+0000","last_became_active":"2024-09-17T04:34:52.076950+0000","last_became_peered":"2024-09-17T04:34:52.076950+0000","last_unstale":"2024-09-17T04:34:53.080159+0000","last_undegraded":"2024-09-17T04:34:53.080159+0000","last_fullsized":"2024-09-17T04:34:53.080159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:06.361530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079837+0000","last_change":"2024-09-17T04:34:52.083859+0000","last_active":"2024-09-17T04:34:53.079837+0000","last_peered":"2024-09-17T04:34:53.079837+0000","last_clean":"2024-09-17T04:34:53.079837+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:34:53.079837+0000","last_undegraded":"2024-09-17T04:34:53.079837+0000","last_fullsized":"2024-09-17T04:34:53.079837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:25.262925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315556+0000","last_change":"2024-09-17T04:34:52.086460+0000","last_active":"2024-09-17T04:34:53.315556+0000","last_peered":"2024-09-17T04:34:53.315556+0000","last_clean":"2024-09-17T04:34:53.315556+0000","last_became_active":"2024-09-17T04:34:52.084848+0000","last_became_peered":"2024-09-17T04:34:52.084848+0000","last_unstale":"2024-09-17T04:34:53.315556+0000","last_undegraded":"2024-09-17T04:34:53.315556+0000","last_fullsized":"2024-09-17T04:34:53.315556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:22.927331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081424+0000","last_change":"2024-09-17T04:34:52.080149+0000","last_active":"2024-09-17T04:34:53.081424+0000","last_peered":"2024-09-17T04:34:53.081424+0000","last_clean":"2024-09-17T04:34:53.081424+0000","last_became_active":"2024-09-17T04:34:52.079490+0000","last_became_peered":"2024-09-17T04:34:52.079490+0000","last_unstale":"2024-09-17T04:34:53.081424+0000","last_undegraded":"2024-09-17T04:34:53.081424+0000","last_fullsized":"2024-09-17T04:34:53.081424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:52.314715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176860+0000","last_change":"2024-09-17T04:34:52.082765+0000","last_active":"2024-09-17T04:34:53.176860+0000","last_peered":"2024-09-17T04:34:53.176860+0000","last_clean":"2024-09-17T04:34:53.176860+0000","last_became_active":"2024-09-17T04:34:52.081049+0000","last_became_peered":"2024-09-17T04:34:52.081049+0000","last_unstale":"2024-09-17T04:34:53.176860+0000","last_undegraded":"2024-09-17T04:34:53.176860+0000","last_fullsized":"2024-09-17T04:34:53.176860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.762553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081112+0000","last_change":"2024-09-17T04:34:52.086233+0000","last_active":"2024-09-17T04:34:53.081112+0000","last_peered":"2024-09-17T04:34:53.081112+0000","last_clean":"2024-09-17T04:34:53.081112+0000","last_became_active":"2024-09-17T04:34:52.085876+0000","last_became_peered":"2024-09-17T04:34:52.085876+0000","last_unstale":"2024-09-17T04:34:53.081112+0000","last_undegraded":"2024-09-17T04:34:53.081112+0000","last_fullsized":"2024-09-17T04:34:53.081112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:44.061677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177349+0000","last_change":"2024-09-17T04:34:52.079305+0000","last_active":"2024-09-17T04:34:53.177349+0000","last_peered":"2024-09-17T04:34:53.177349+0000","last_clean":"2024-09-17T04:34:53.177349+0000","last_became_active":"2024-09-17T04:34:52.078984+0000","last_became_peered":"2024-09-17T04:34:52.078984+0000","last_unstale":"2024-09-17T04:34:53.177349+0000","last_undegraded":"2024-09-17T04:34:53.177349+0000","last_fullsized":"2024-09-17T04:34:53.177349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:15.927488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080877+0000","last_change":"2024-09-17T04:34:52.077495+0000","last_active":"2024-09-17T04:34:53.080877+0000","last_peered":"2024-09-17T04:34:53.080877+0000","last_clean":"2024-09-17T04:34:53.080877+0000","last_became_active":"2024-09-17T04:34:52.077167+0000","last_became_peered":"2024-09-17T04:34:52.077167+0000","last_unstale":"2024-09-17T04:34:53.080877+0000","last_undegraded":"2024-09-17T04:34:53.080877+0000","last_fullsized":"2024-09-17T04:34:53.080877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.411611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076209+0000","last_change":"2024-09-17T04:34:52.077389+0000","last_active":"2024-09-17T04:34:53.076209+0000","last_peered":"2024-09-17T04:34:53.076209+0000","last_clean":"2024-09-17T04:34:53.076209+0000","last_became_active":"2024-09-17T04:34:52.076993+0000","last_became_peered":"2024-09-17T04:34:52.076993+0000","last_unstale":"2024-09-17T04:34:53.076209+0000","last_undegraded":"2024-09-17T04:34:53.076209+0000","last_fullsized":"2024-09-17T04:34:53.076209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:18.540098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177228+0000","last_change":"2024-09-17T04:34:52.080545+0000","last_active":"2024-09-17T04:34:53.177228+0000","last_peered":"2024-09-17T04:34:53.177228+0000","last_clean":"2024-09-17T04:34:53.177228+0000","last_became_active":"2024-09-17T04:34:52.079930+0000","last_became_peered":"2024-09-17T04:34:52.079930+0000","last_unstale":"2024-09-17T04:34:53.177228+0000","last_undegraded":"2024-09-17T04:34:53.177228+0000","last_fullsized":"2024-09-17T04:34:53.177228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:50.491050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315714+0000","last_change":"2024-09-17T04:34:52.083598+0000","last_active":"2024-09-17T04:34:53.315714+0000","last_peered":"2024-09-17T04:34:53.315714+0000","last_clean":"2024-09-17T04:34:53.315714+0000","last_became_active":"2024-09-17T04:34:52.083225+0000","last_became_peered":"2024-09-17T04:34:52.083225+0000","last_unstale":"2024-09-17T04:34:53.315714+0000","last_undegraded":"2024-09-17T04:34:53.315714+0000","last_fullsized":"2024-09-17T04:34:53.315714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:22.713546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081731+0000","last_change":"2024-09-17T04:34:52.078977+0000","last_active":"2024-09-17T04:34:53.081731+0000","last_peered":"2024-09-17T04:34:53.081731+0000","last_clean":"2024-09-17T04:34:53.081731+0000","last_became_active":"2024-09-17T04:34:52.078636+0000","last_became_peered":"2024-09-17T04:34:52.078636+0000","last_unstale":"2024-09-17T04:34:53.081731+0000","last_undegraded":"2024-09-17T04:34:53.081731+0000","last_fullsized":"2024-09-17T04:34:53.081731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:30.144564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315840+0000","last_change":"2024-09-17T04:34:52.082113+0000","last_active":"2024-09-17T04:34:53.315840+0000","last_peered":"2024-09-17T04:34:53.315840+0000","last_clean":"2024-09-17T04:34:53.315840+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:34:53.315840+0000","last_undegraded":"2024-09-17T04:34:53.315840+0000","last_fullsized":"2024-09-17T04:34:53.315840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:52.744564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.078708+0000","last_change":"2024-09-17T04:34:52.083306+0000","last_active":"2024-09-17T04:34:53.078708+0000","last_peered":"2024-09-17T04:34:53.078708+0000","last_clean":"2024-09-17T04:34:53.078708+0000","last_became_active":"2024-09-17T04:34:52.082590+0000","last_became_peered":"2024-09-17T04:34:52.082590+0000","last_unstale":"2024-09-17T04:34:53.078708+0000","last_undegraded":"2024-09-17T04:34:53.078708+0000","last_fullsized":"2024-09-17T04:34:53.078708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:21.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.317989+0000","last_change":"2024-09-17T04:34:52.070155+0000","last_active":"2024-09-17T04:34:53.317989+0000","last_peered":"2024-09-17T04:34:53.317989+0000","last_clean":"2024-09-17T04:34:53.317989+0000","last_became_active":"2024-09-17T04:34:52.069498+0000","last_became_peered":"2024-09-17T04:34:52.069498+0000","last_unstale":"2024-09-17T04:34:53.317989+0000","last_undegraded":"2024-09-17T04:34:53.317989+0000","last_fullsized":"2024-09-17T04:34:53.317989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:24.539277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177313+0000","last_change":"2024-09-17T04:34:51.074188+0000","last_active":"2024-09-17T04:34:53.177313+0000","last_peered":"2024-09-17T04:34:53.177313+0000","last_clean":"2024-09-17T04:34:53.177313+0000","last_became_active":"2024-09-17T04:34:51.073740+0000","last_became_peered":"2024-09-17T04:34:51.073740+0000","last_unstale":"2024-09-17T04:34:53.177313+0000","last_undegraded":"2024-09-17T04:34:53.177313+0000","last_fullsized":"2024-09-17T04:34:53.177313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:36.692687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315954+0000","last_change":"2024-09-17T04:34:52.081048+0000","last_active":"2024-09-17T04:34:53.315954+0000","last_peered":"2024-09-17T04:34:53.315954+0000","last_clean":"2024-09-17T04:34:53.315954+0000","last_became_active":"2024-09-17T04:34:52.080703+0000","last_became_peered":"2024-09-17T04:34:52.080703+0000","last_unstale":"2024-09-17T04:34:53.315954+0000","last_undegraded":"2024-09-17T04:34:53.315954+0000","last_fullsized":"2024-09-17T04:34:53.315954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:05.164849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079196+0000","last_change":"2024-09-17T04:34:51.078602+0000","last_active":"2024-09-17T04:34:53.079196+0000","last_peered":"2024-09-17T04:34:53.079196+0000","last_clean":"2024-09-17T04:34:53.079196+0000","last_became_active":"2024-09-17T04:34:51.078221+0000","last_became_peered":"2024-09-17T04:34:51.078221+0000","last_unstale":"2024-09-17T04:34:53.079196+0000","last_undegraded":"2024-09-17T04:34:53.079196+0000","last_fullsized":"2024-09-17T04:34:53.079196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:59.716216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176933+0000","last_change":"2024-09-17T04:34:51.077573+0000","last_active":"2024-09-17T04:34:53.176933+0000","last_peered":"2024-09-17T04:34:53.176933+0000","last_clean":"2024-09-17T04:34:53.176933+0000","last_became_active":"2024-09-17T04:34:51.077225+0000","last_became_peered":"2024-09-17T04:34:51.077225+0000","last_unstale":"2024-09-17T04:34:53.176933+0000","last_undegraded":"2024-09-17T04:34:53.176933+0000","last_fullsized":"2024-09-17T04:34:53.176933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:29.348927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176928+0000","last_change":"2024-09-17T04:34:52.074356+0000","last_active":"2024-09-17T04:34:53.176928+0000","last_peered":"2024-09-17T04:34:53.176928+0000","last_clean":"2024-09-17T04:34:53.176928+0000","last_became_active":"2024-09-17T04:34:52.072796+0000","last_became_peered":"2024-09-17T04:34:52.072796+0000","last_unstale":"2024-09-17T04:34:53.176928+0000","last_undegraded":"2024-09-17T04:34:53.176928+0000","last_fullsized":"2024-09-17T04:34:53.176928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:53.971839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081155+0000","last_change":"2024-09-17T04:34:51.074170+0000","last_active":"2024-09-17T04:34:53.081155+0000","last_peered":"2024-09-17T04:34:53.081155+0000","last_clean":"2024-09-17T04:34:53.081155+0000","last_became_active":"2024-09-17T04:34:51.073836+0000","last_became_peered":"2024-09-17T04:34:51.073836+0000","last_unstale":"2024-09-17T04:34:53.081155+0000","last_undegraded":"2024-09-17T04:34:53.081155+0000","last_fullsized":"2024-09-17T04:34:53.081155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:30.884002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075826+0000","last_change":"2024-09-17T04:34:52.078331+0000","last_active":"2024-09-17T04:34:53.075826+0000","last_peered":"2024-09-17T04:34:53.075826+0000","last_clean":"2024-09-17T04:34:53.075826+0000","last_became_active":"2024-09-17T04:34:52.078012+0000","last_became_peered":"2024-09-17T04:34:52.078012+0000","last_unstale":"2024-09-17T04:34:53.075826+0000","last_undegraded":"2024-09-17T04:34:53.075826+0000","last_fullsized":"2024-09-17T04:34:53.075826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:28.961571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.078937+0000","last_change":"2024-09-17T04:34:51.077676+0000","last_active":"2024-09-17T04:34:53.078937+0000","last_peered":"2024-09-17T04:34:53.078937+0000","last_clean":"2024-09-17T04:34:53.078937+0000","last_became_active":"2024-09-17T04:34:51.076291+0000","last_became_peered":"2024-09-17T04:34:51.076291+0000","last_unstale":"2024-09-17T04:34:53.078937+0000","last_undegraded":"2024-09-17T04:34:53.078937+0000","last_fullsized":"2024-09-17T04:34:53.078937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:42.622688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081329+0000","last_change":"2024-09-17T04:34:52.075624+0000","last_active":"2024-09-17T04:34:53.081329+0000","last_peered":"2024-09-17T04:34:53.081329+0000","last_clean":"2024-09-17T04:34:53.081329+0000","last_became_active":"2024-09-17T04:34:52.074943+0000","last_became_peered":"2024-09-17T04:34:52.074943+0000","last_unstale":"2024-09-17T04:34:53.081329+0000","last_undegraded":"2024-09-17T04:34:53.081329+0000","last_fullsized":"2024-09-17T04:34:53.081329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:56.749605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081379+0000","last_change":"2024-09-17T04:34:51.077199+0000","last_active":"2024-09-17T04:34:53.081379+0000","last_peered":"2024-09-17T04:34:53.081379+0000","last_clean":"2024-09-17T04:34:53.081379+0000","last_became_active":"2024-09-17T04:34:51.076867+0000","last_became_peered":"2024-09-17T04:34:51.076867+0000","last_unstale":"2024-09-17T04:34:53.081379+0000","last_undegraded":"2024-09-17T04:34:53.081379+0000","last_fullsized":"2024-09-17T04:34:53.081379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:09.194133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315797+0000","last_change":"2024-09-17T04:34:52.083401+0000","last_active":"2024-09-17T04:34:53.315797+0000","last_peered":"2024-09-17T04:34:53.315797+0000","last_clean":"2024-09-17T04:34:53.315797+0000","last_became_active":"2024-09-17T04:34:52.083086+0000","last_became_peered":"2024-09-17T04:34:52.083086+0000","last_unstale":"2024-09-17T04:34:53.315797+0000","last_undegraded":"2024-09-17T04:34:53.315797+0000","last_fullsized":"2024-09-17T04:34:53.315797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.237945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076139+0000","last_change":"2024-09-17T04:34:51.070235+0000","last_active":"2024-09-17T04:34:53.076139+0000","last_peered":"2024-09-17T04:34:53.076139+0000","last_clean":"2024-09-17T04:34:53.076139+0000","last_became_active":"2024-09-17T04:34:51.069278+0000","last_became_peered":"2024-09-17T04:34:51.069278+0000","last_unstale":"2024-09-17T04:34:53.076139+0000","last_undegraded":"2024-09-17T04:34:53.076139+0000","last_fullsized":"2024-09-17T04:34:53.076139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:55.959278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318073+0000","last_change":"2024-09-17T04:34:52.076233+0000","last_active":"2024-09-17T04:34:53.318073+0000","last_peered":"2024-09-17T04:34:53.318073+0000","last_clean":"2024-09-17T04:34:53.318073+0000","last_became_active":"2024-09-17T04:34:52.075682+0000","last_became_peered":"2024-09-17T04:34:52.075682+0000","last_unstale":"2024-09-17T04:34:53.318073+0000","last_undegraded":"2024-09-17T04:34:53.318073+0000","last_fullsized":"2024-09-17T04:34:53.318073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:22.047574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080017+0000","last_change":"2024-09-17T04:34:51.076416+0000","last_active":"2024-09-17T04:34:53.080017+0000","last_peered":"2024-09-17T04:34:53.080017+0000","last_clean":"2024-09-17T04:34:53.080017+0000","last_became_active":"2024-09-17T04:34:51.076051+0000","last_became_peered":"2024-09-17T04:34:51.076051+0000","last_unstale":"2024-09-17T04:34:53.080017+0000","last_undegraded":"2024-09-17T04:34:53.080017+0000","last_fullsized":"2024-09-17T04:34:53.080017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:52.255204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079732+0000","last_change":"2024-09-17T04:34:52.086230+0000","last_active":"2024-09-17T04:34:53.079732+0000","last_peered":"2024-09-17T04:34:53.079732+0000","last_clean":"2024-09-17T04:34:53.079732+0000","last_became_active":"2024-09-17T04:34:52.085910+0000","last_became_peered":"2024-09-17T04:34:52.085910+0000","last_unstale":"2024-09-17T04:34:53.079732+0000","last_undegraded":"2024-09-17T04:34:53.079732+0000","last_fullsized":"2024-09-17T04:34:53.079732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:36.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315892+0000","last_change":"2024-09-17T04:34:51.075224+0000","last_active":"2024-09-17T04:34:53.315892+0000","last_peered":"2024-09-17T04:34:53.315892+0000","last_clean":"2024-09-17T04:34:53.315892+0000","last_became_active":"2024-09-17T04:34:51.074912+0000","last_became_peered":"2024-09-17T04:34:51.074912+0000","last_unstale":"2024-09-17T04:34:53.315892+0000","last_undegraded":"2024-09-17T04:34:53.315892+0000","last_fullsized":"2024-09-17T04:34:53.315892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:33.811243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315617+0000","last_change":"2024-09-17T04:34:52.085906+0000","last_active":"2024-09-17T04:34:53.315617+0000","last_peered":"2024-09-17T04:34:53.315617+0000","last_clean":"2024-09-17T04:34:53.315617+0000","last_became_active":"2024-09-17T04:34:52.085538+0000","last_became_peered":"2024-09-17T04:34:52.085538+0000","last_unstale":"2024-09-17T04:34:53.315617+0000","last_undegraded":"2024-09-17T04:34:53.315617+0000","last_fullsized":"2024-09-17T04:34:53.315617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:21.997395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081689+0000","last_change":"2024-09-17T04:34:51.074253+0000","last_active":"2024-09-17T04:34:53.081689+0000","last_peered":"2024-09-17T04:34:53.081689+0000","last_clean":"2024-09-17T04:34:53.081689+0000","last_became_active":"2024-09-17T04:34:51.073812+0000","last_became_peered":"2024-09-17T04:34:51.073812+0000","last_unstale":"2024-09-17T04:34:53.081689+0000","last_undegraded":"2024-09-17T04:34:53.081689+0000","last_fullsized":"2024-09-17T04:34:53.081689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:38.971561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081022+0000","last_change":"2024-09-17T04:34:52.082137+0000","last_active":"2024-09-17T04:34:53.081022+0000","last_peered":"2024-09-17T04:34:53.081022+0000","last_clean":"2024-09-17T04:34:53.081022+0000","last_became_active":"2024-09-17T04:34:52.081775+0000","last_became_peered":"2024-09-17T04:34:52.081775+0000","last_unstale":"2024-09-17T04:34:53.081022+0000","last_undegraded":"2024-09-17T04:34:53.081022+0000","last_fullsized":"2024-09-17T04:34:53.081022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:57.911822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080176+0000","last_change":"2024-09-17T04:34:51.077157+0000","last_active":"2024-09-17T04:34:53.080176+0000","last_peered":"2024-09-17T04:34:53.080176+0000","last_clean":"2024-09-17T04:34:53.080176+0000","last_became_active":"2024-09-17T04:34:51.076797+0000","last_became_peered":"2024-09-17T04:34:51.076797+0000","last_unstale":"2024-09-17T04:34:53.080176+0000","last_undegraded":"2024-09-17T04:34:53.080176+0000","last_fullsized":"2024-09-17T04:34:53.080176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:20.118978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079355+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:34:53.079355+0000","last_peered":"2024-09-17T04:34:53.079355+0000","last_clean":"2024-09-17T04:34:53.079355+0000","last_became_active":"2024-09-17T04:34:52.082118+0000","last_became_peered":"2024-09-17T04:34:52.082118+0000","last_unstale":"2024-09-17T04:34:53.079355+0000","last_undegraded":"2024-09-17T04:34:53.079355+0000","last_fullsized":"2024-09-17T04:34:53.079355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:44.752945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315385+0000","last_change":"2024-09-17T04:34:51.071083+0000","last_active":"2024-09-17T04:34:53.315385+0000","last_peered":"2024-09-17T04:34:53.315385+0000","last_clean":"2024-09-17T04:34:53.315385+0000","last_became_active":"2024-09-17T04:34:51.070733+0000","last_became_peered":"2024-09-17T04:34:51.070733+0000","last_unstale":"2024-09-17T04:34:53.315385+0000","last_undegraded":"2024-09-17T04:34:53.315385+0000","last_fullsized":"2024-09-17T04:34:53.315385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:36.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079638+0000","last_change":"2024-09-17T04:34:52.080277+0000","last_active":"2024-09-17T04:34:53.079638+0000","last_peered":"2024-09-17T04:34:53.079638+0000","last_clean":"2024-09-17T04:34:53.079638+0000","last_became_active":"2024-09-17T04:34:52.079969+0000","last_became_peered":"2024-09-17T04:34:52.079969+0000","last_unstale":"2024-09-17T04:34:53.079638+0000","last_undegraded":"2024-09-17T04:34:53.079638+0000","last_fullsized":"2024-09-17T04:34:53.079638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:10.360905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318123+0000","last_change":"2024-09-17T04:34:51.074800+0000","last_active":"2024-09-17T04:34:53.318123+0000","last_peered":"2024-09-17T04:34:53.318123+0000","last_clean":"2024-09-17T04:34:53.318123+0000","last_became_active":"2024-09-17T04:34:51.073287+0000","last_became_peered":"2024-09-17T04:34:51.073287+0000","last_unstale":"2024-09-17T04:34:53.318123+0000","last_undegraded":"2024-09-17T04:34:53.318123+0000","last_fullsized":"2024-09-17T04:34:53.318123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:19.933857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079619+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:34:53.079619+0000","last_peered":"2024-09-17T04:34:53.079619+0000","last_clean":"2024-09-17T04:34:53.079619+0000","last_became_active":"2024-09-17T04:34:52.082607+0000","last_became_peered":"2024-09-17T04:34:52.082607+0000","last_unstale":"2024-09-17T04:34:53.079619+0000","last_undegraded":"2024-09-17T04:34:53.079619+0000","last_fullsized":"2024-09-17T04:34:53.079619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:08.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.316047+0000","last_change":"2024-09-17T04:34:51.077171+0000","last_active":"2024-09-17T04:34:53.316047+0000","last_peered":"2024-09-17T04:34:53.316047+0000","last_clean":"2024-09-17T04:34:53.316047+0000","last_became_active":"2024-09-17T04:34:51.076780+0000","last_became_peered":"2024-09-17T04:34:51.076780+0000","last_unstale":"2024-09-17T04:34:53.316047+0000","last_undegraded":"2024-09-17T04:34:53.316047+0000","last_fullsized":"2024-09-17T04:34:53.316047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:40.031852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079942+0000","last_change":"2024-09-17T04:34:52.080032+0000","last_active":"2024-09-17T04:34:53.079942+0000","last_peered":"2024-09-17T04:34:53.079942+0000","last_clean":"2024-09-17T04:34:53.079942+0000","last_became_active":"2024-09-17T04:34:52.079536+0000","last_became_peered":"2024-09-17T04:34:52.079536+0000","last_unstale":"2024-09-17T04:34:53.079942+0000","last_undegraded":"2024-09-17T04:34:53.079942+0000","last_fullsized":"2024-09-17T04:34:53.079942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:55.220027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076248+0000","last_change":"2024-09-17T04:34:51.071053+0000","last_active":"2024-09-17T04:34:53.076248+0000","last_peered":"2024-09-17T04:34:53.076248+0000","last_clean":"2024-09-17T04:34:53.076248+0000","last_became_active":"2024-09-17T04:34:51.070673+0000","last_became_peered":"2024-09-17T04:34:51.070673+0000","last_unstale":"2024-09-17T04:34:53.076248+0000","last_undegraded":"2024-09-17T04:34:53.076248+0000","last_fullsized":"2024-09-17T04:34:53.076248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:31.660200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081894+0000","last_change":"2024-09-17T04:34:52.077963+0000","last_active":"2024-09-17T04:34:53.081894+0000","last_peered":"2024-09-17T04:34:53.081894+0000","last_clean":"2024-09-17T04:34:53.081894+0000","last_became_active":"2024-09-17T04:34:52.077499+0000","last_became_peered":"2024-09-17T04:34:52.077499+0000","last_unstale":"2024-09-17T04:34:53.081894+0000","last_undegraded":"2024-09-17T04:34:53.081894+0000","last_fullsized":"2024-09-17T04:34:53.081894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:25.309696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.316030+0000","last_change":"2024-09-17T04:34:51.070532+0000","last_active":"2024-09-17T04:34:53.316030+0000","last_peered":"2024-09-17T04:34:53.316030+0000","last_clean":"2024-09-17T04:34:53.316030+0000","last_became_active":"2024-09-17T04:34:51.070179+0000","last_became_peered":"2024-09-17T04:34:51.070179+0000","last_unstale":"2024-09-17T04:34:53.316030+0000","last_undegraded":"2024-09-17T04:34:53.316030+0000","last_fullsized":"2024-09-17T04:34:53.316030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:52.027096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079935+0000","last_change":"2024-09-17T04:34:52.083159+0000","last_active":"2024-09-17T04:34:53.079935+0000","last_peered":"2024-09-17T04:34:53.079935+0000","last_clean":"2024-09-17T04:34:53.079935+0000","last_became_active":"2024-09-17T04:34:52.082847+0000","last_became_peered":"2024-09-17T04:34:52.082847+0000","last_unstale":"2024-09-17T04:34:53.079935+0000","last_undegraded":"2024-09-17T04:34:53.079935+0000","last_fullsized":"2024-09-17T04:34:53.079935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:25.210506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080417+0000","last_change":"2024-09-17T04:34:41.975789+0000","last_active":"2024-09-17T04:34:53.080417+0000","last_peered":"2024-09-17T04:34:53.080417+0000","last_clean":"2024-09-17T04:34:53.080417+0000","last_became_active":"2024-09-17T04:34:41.974664+0000","last_became_peered":"2024-09-17T04:34:41.974664+0000","last_unstale":"2024-09-17T04:34:53.080417+0000","last_undegraded":"2024-09-17T04:34:53.080417+0000","last_fullsized":"2024-09-17T04:34:53.080417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_clean_scrub_stamp":"2024-09-17T04:34:39.702713+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:30.302931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080987+0000","last_change":"2024-09-17T04:34:51.068782+0000","last_active":"2024-09-17T04:34:53.080987+0000","last_peered":"2024-09-17T04:34:53.080987+0000","last_clean":"2024-09-17T04:34:53.080987+0000","last_became_active":"2024-09-17T04:34:51.068375+0000","last_became_peered":"2024-09-17T04:34:51.068375+0000","last_unstale":"2024-09-17T04:34:53.080987+0000","last_undegraded":"2024-09-17T04:34:53.080987+0000","last_fullsized":"2024-09-17T04:34:53.080987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:25.307166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177343+0000","last_change":"2024-09-17T04:34:52.086768+0000","last_active":"2024-09-17T04:34:53.177343+0000","last_peered":"2024-09-17T04:34:53.177343+0000","last_clean":"2024-09-17T04:34:53.177343+0000","last_became_active":"2024-09-17T04:34:52.086415+0000","last_became_peered":"2024-09-17T04:34:52.086415+0000","last_unstale":"2024-09-17T04:34:53.177343+0000","last_undegraded":"2024-09-17T04:34:53.177343+0000","last_fullsized":"2024-09-17T04:34:53.177343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:45.527873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080288+0000","last_change":"2024-09-17T04:34:51.075655+0000","last_active":"2024-09-17T04:34:53.080288+0000","last_peered":"2024-09-17T04:34:53.080288+0000","last_clean":"2024-09-17T04:34:53.080288+0000","last_became_active":"2024-09-17T04:34:51.075313+0000","last_became_peered":"2024-09-17T04:34:51.075313+0000","last_unstale":"2024-09-17T04:34:53.080288+0000","last_undegraded":"2024-09-17T04:34:53.080288+0000","last_fullsized":"2024-09-17T04:34:53.080288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:47.853850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315306+0000","last_change":"2024-09-17T04:34:52.080065+0000","last_active":"2024-09-17T04:34:53.315306+0000","last_peered":"2024-09-17T04:34:53.315306+0000","last_clean":"2024-09-17T04:34:53.315306+0000","last_became_active":"2024-09-17T04:34:52.079672+0000","last_became_peered":"2024-09-17T04:34:52.079672+0000","last_unstale":"2024-09-17T04:34:53.315306+0000","last_undegraded":"2024-09-17T04:34:53.315306+0000","last_fullsized":"2024-09-17T04:34:53.315306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:52.040153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315786+0000","last_change":"2024-09-17T04:34:51.075960+0000","last_active":"2024-09-17T04:34:53.315786+0000","last_peered":"2024-09-17T04:34:53.315786+0000","last_clean":"2024-09-17T04:34:53.315786+0000","last_became_active":"2024-09-17T04:34:51.075561+0000","last_became_peered":"2024-09-17T04:34:51.075561+0000","last_unstale":"2024-09-17T04:34:53.315786+0000","last_undegraded":"2024-09-17T04:34:53.315786+0000","last_fullsized":"2024-09-17T04:34:53.315786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:44.834618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075859+0000","last_change":"2024-09-17T04:34:52.070068+0000","last_active":"2024-09-17T04:34:53.075859+0000","last_peered":"2024-09-17T04:34:53.075859+0000","last_clean":"2024-09-17T04:34:53.075859+0000","last_became_active":"2024-09-17T04:34:52.069669+0000","last_became_peered":"2024-09-17T04:34:52.069669+0000","last_unstale":"2024-09-17T04:34:53.075859+0000","last_undegraded":"2024-09-17T04:34:53.075859+0000","last_fullsized":"2024-09-17T04:34:53.075859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:39.617045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081829+0000","last_change":"2024-09-17T04:34:51.070187+0000","last_active":"2024-09-17T04:34:53.081829+0000","last_peered":"2024-09-17T04:34:53.081829+0000","last_clean":"2024-09-17T04:34:53.081829+0000","last_became_active":"2024-09-17T04:34:51.069714+0000","last_became_peered":"2024-09-17T04:34:51.069714+0000","last_unstale":"2024-09-17T04:34:53.081829+0000","last_undegraded":"2024-09-17T04:34:53.081829+0000","last_fullsized":"2024-09-17T04:34:53.081829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:28.082690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318145+0000","last_change":"2024-09-17T04:34:52.069653+0000","last_active":"2024-09-17T04:34:53.318145+0000","last_peered":"2024-09-17T04:34:53.318145+0000","last_clean":"2024-09-17T04:34:53.318145+0000","last_became_active":"2024-09-17T04:34:52.069282+0000","last_became_peered":"2024-09-17T04:34:52.069282+0000","last_unstale":"2024-09-17T04:34:53.318145+0000","last_undegraded":"2024-09-17T04:34:53.318145+0000","last_fullsized":"2024-09-17T04:34:53.318145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:40.828725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076208+0000","last_change":"2024-09-17T04:34:51.070676+0000","last_active":"2024-09-17T04:34:53.076208+0000","last_peered":"2024-09-17T04:34:53.076208+0000","last_clean":"2024-09-17T04:34:53.076208+0000","last_became_active":"2024-09-17T04:34:51.069006+0000","last_became_peered":"2024-09-17T04:34:51.069006+0000","last_unstale":"2024-09-17T04:34:53.076208+0000","last_undegraded":"2024-09-17T04:34:53.076208+0000","last_fullsized":"2024-09-17T04:34:53.076208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:45.452865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081804+0000","last_change":"2024-09-17T04:34:52.087131+0000","last_active":"2024-09-17T04:34:53.081804+0000","last_peered":"2024-09-17T04:34:53.081804+0000","last_clean":"2024-09-17T04:34:53.081804+0000","last_became_active":"2024-09-17T04:34:52.086782+0000","last_became_peered":"2024-09-17T04:34:52.086782+0000","last_unstale":"2024-09-17T04:34:53.081804+0000","last_undegraded":"2024-09-17T04:34:53.081804+0000","last_fullsized":"2024-09-17T04:34:53.081804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:53.987579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080352+0000","last_change":"2024-09-17T04:34:51.068708+0000","last_active":"2024-09-17T04:34:53.080352+0000","last_peered":"2024-09-17T04:34:53.080352+0000","last_clean":"2024-09-17T04:34:53.080352+0000","last_became_active":"2024-09-17T04:34:51.068354+0000","last_became_peered":"2024-09-17T04:34:51.068354+0000","last_unstale":"2024-09-17T04:34:53.080352+0000","last_undegraded":"2024-09-17T04:34:53.080352+0000","last_fullsized":"2024-09-17T04:34:53.080352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:04.219898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076122+0000","last_change":"2024-09-17T04:34:52.071586+0000","last_active":"2024-09-17T04:34:53.076122+0000","last_peered":"2024-09-17T04:34:53.076122+0000","last_clean":"2024-09-17T04:34:53.076122+0000","last_became_active":"2024-09-17T04:34:52.071246+0000","last_became_peered":"2024-09-17T04:34:52.071246+0000","last_unstale":"2024-09-17T04:34:53.076122+0000","last_undegraded":"2024-09-17T04:34:53.076122+0000","last_fullsized":"2024-09-17T04:34:53.076122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:03.620107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076048+0000","last_change":"2024-09-17T04:34:51.078947+0000","last_active":"2024-09-17T04:34:53.076048+0000","last_peered":"2024-09-17T04:34:53.076048+0000","last_clean":"2024-09-17T04:34:53.076048+0000","last_became_active":"2024-09-17T04:34:51.078557+0000","last_became_peered":"2024-09-17T04:34:51.078557+0000","last_unstale":"2024-09-17T04:34:53.076048+0000","last_undegraded":"2024-09-17T04:34:53.076048+0000","last_fullsized":"2024-09-17T04:34:53.076048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:51.413772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177384+0000","last_change":"2024-09-17T04:34:52.086372+0000","last_active":"2024-09-17T04:34:53.177384+0000","last_peered":"2024-09-17T04:34:53.177384+0000","last_clean":"2024-09-17T04:34:53.177384+0000","last_became_active":"2024-09-17T04:34:52.086018+0000","last_became_peered":"2024-09-17T04:34:52.086018+0000","last_unstale":"2024-09-17T04:34:53.177384+0000","last_undegraded":"2024-09-17T04:34:53.177384+0000","last_fullsized":"2024-09-17T04:34:53.177384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:10.818503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079074+0000","last_change":"2024-09-17T04:34:51.076427+0000","last_active":"2024-09-17T04:34:53.079074+0000","last_peered":"2024-09-17T04:34:53.079074+0000","last_clean":"2024-09-17T04:34:53.079074+0000","last_became_active":"2024-09-17T04:34:51.075881+0000","last_became_peered":"2024-09-17T04:34:51.075881+0000","last_unstale":"2024-09-17T04:34:53.079074+0000","last_undegraded":"2024-09-17T04:34:53.079074+0000","last_fullsized":"2024-09-17T04:34:53.079074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:40.903989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315468+0000","last_change":"2024-09-17T04:34:52.076358+0000","last_active":"2024-09-17T04:34:53.315468+0000","last_peered":"2024-09-17T04:34:53.315468+0000","last_clean":"2024-09-17T04:34:53.315468+0000","last_became_active":"2024-09-17T04:34:52.076035+0000","last_became_peered":"2024-09-17T04:34:52.076035+0000","last_unstale":"2024-09-17T04:34:53.315468+0000","last_undegraded":"2024-09-17T04:34:53.315468+0000","last_fullsized":"2024-09-17T04:34:53.315468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:30.660617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080167+0000","last_change":"2024-09-17T04:34:51.072737+0000","last_active":"2024-09-17T04:34:53.080167+0000","last_peered":"2024-09-17T04:34:53.080167+0000","last_clean":"2024-09-17T04:34:53.080167+0000","last_became_active":"2024-09-17T04:34:51.072378+0000","last_became_peered":"2024-09-17T04:34:51.072378+0000","last_unstale":"2024-09-17T04:34:53.080167+0000","last_undegraded":"2024-09-17T04:34:53.080167+0000","last_fullsized":"2024-09-17T04:34:53.080167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:27.364636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318181+0000","last_change":"2024-09-17T04:34:52.068446+0000","last_active":"2024-09-17T04:34:53.318181+0000","last_peered":"2024-09-17T04:34:53.318181+0000","last_clean":"2024-09-17T04:34:53.318181+0000","last_became_active":"2024-09-17T04:34:52.068047+0000","last_became_peered":"2024-09-17T04:34:52.068047+0000","last_unstale":"2024-09-17T04:34:53.318181+0000","last_undegraded":"2024-09-17T04:34:53.318181+0000","last_fullsized":"2024-09-17T04:34:53.318181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:26.994189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075960+0000","last_change":"2024-09-17T04:34:51.069539+0000","last_active":"2024-09-17T04:34:53.075960+0000","last_peered":"2024-09-17T04:34:53.075960+0000","last_clean":"2024-09-17T04:34:53.075960+0000","last_became_active":"2024-09-17T04:34:51.067438+0000","last_became_peered":"2024-09-17T04:34:51.067438+0000","last_unstale":"2024-09-17T04:34:53.075960+0000","last_undegraded":"2024-09-17T04:34:53.075960+0000","last_fullsized":"2024-09-17T04:34:53.075960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:13.078391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177144+0000","last_change":"2024-09-17T04:34:52.078035+0000","last_active":"2024-09-17T04:34:53.177144+0000","last_peered":"2024-09-17T04:34:53.177144+0000","last_clean":"2024-09-17T04:34:53.177144+0000","last_became_active":"2024-09-17T04:34:52.077708+0000","last_became_peered":"2024-09-17T04:34:52.077708+0000","last_unstale":"2024-09-17T04:34:53.177144+0000","last_undegraded":"2024-09-17T04:34:53.177144+0000","last_fullsized":"2024-09-17T04:34:53.177144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:00.313209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076024+0000","last_change":"2024-09-17T04:34:51.074749+0000","last_active":"2024-09-17T04:34:53.076024+0000","last_peered":"2024-09-17T04:34:53.076024+0000","last_clean":"2024-09-17T04:34:53.076024+0000","last_became_active":"2024-09-17T04:34:51.074393+0000","last_became_peered":"2024-09-17T04:34:51.074393+0000","last_unstale":"2024-09-17T04:34:53.076024+0000","last_undegraded":"2024-09-17T04:34:53.076024+0000","last_fullsized":"2024-09-17T04:34:53.076024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:39.558815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177339+0000","last_change":"2024-09-17T04:34:52.075585+0000","last_active":"2024-09-17T04:34:53.177339+0000","last_peered":"2024-09-17T04:34:53.177339+0000","last_clean":"2024-09-17T04:34:53.177339+0000","last_became_active":"2024-09-17T04:34:52.075257+0000","last_became_peered":"2024-09-17T04:34:52.075257+0000","last_unstale":"2024-09-17T04:34:53.177339+0000","last_undegraded":"2024-09-17T04:34:53.177339+0000","last_fullsized":"2024-09-17T04:34:53.177339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:38.029256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080942+0000","last_change":"2024-09-17T04:34:51.071324+0000","last_active":"2024-09-17T04:34:53.080942+0000","last_peered":"2024-09-17T04:34:53.080942+0000","last_clean":"2024-09-17T04:34:53.080942+0000","last_became_active":"2024-09-17T04:34:51.070944+0000","last_became_peered":"2024-09-17T04:34:51.070944+0000","last_unstale":"2024-09-17T04:34:53.080942+0000","last_undegraded":"2024-09-17T04:34:53.080942+0000","last_fullsized":"2024-09-17T04:34:53.080942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:13.931324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079005+0000","last_change":"2024-09-17T04:34:52.081178+0000","last_active":"2024-09-17T04:34:53.079005+0000","last_peered":"2024-09-17T04:34:53.079005+0000","last_clean":"2024-09-17T04:34:53.079005+0000","last_became_active":"2024-09-17T04:34:52.080855+0000","last_became_peered":"2024-09-17T04:34:52.080855+0000","last_unstale":"2024-09-17T04:34:53.079005+0000","last_undegraded":"2024-09-17T04:34:53.079005+0000","last_fullsized":"2024-09-17T04:34:53.079005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:49.091080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081719+0000","last_change":"2024-09-17T04:34:52.066633+0000","last_active":"2024-09-17T04:34:53.081719+0000","last_peered":"2024-09-17T04:34:53.081719+0000","last_clean":"2024-09-17T04:34:53.081719+0000","last_became_active":"2024-09-17T04:34:52.066263+0000","last_became_peered":"2024-09-17T04:34:52.066263+0000","last_unstale":"2024-09-17T04:34:53.081719+0000","last_undegraded":"2024-09-17T04:34:53.081719+0000","last_fullsized":"2024-09-17T04:34:53.081719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:13.396220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079366+0000","last_change":"2024-09-17T04:34:51.067927+0000","last_active":"2024-09-17T04:34:53.079366+0000","last_peered":"2024-09-17T04:34:53.079366+0000","last_clean":"2024-09-17T04:34:53.079366+0000","last_became_active":"2024-09-17T04:34:51.067555+0000","last_became_peered":"2024-09-17T04:34:51.067555+0000","last_unstale":"2024-09-17T04:34:53.079366+0000","last_undegraded":"2024-09-17T04:34:53.079366+0000","last_fullsized":"2024-09-17T04:34:53.079366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:33.815585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081560+0000","last_change":"2024-09-17T04:34:52.074529+0000","last_active":"2024-09-17T04:34:53.081560+0000","last_peered":"2024-09-17T04:34:53.081560+0000","last_clean":"2024-09-17T04:34:53.081560+0000","last_became_active":"2024-09-17T04:34:52.074149+0000","last_became_peered":"2024-09-17T04:34:52.074149+0000","last_unstale":"2024-09-17T04:34:53.081560+0000","last_undegraded":"2024-09-17T04:34:53.081560+0000","last_fullsized":"2024-09-17T04:34:53.081560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:31.679908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079953+0000","last_change":"2024-09-17T04:34:51.078231+0000","last_active":"2024-09-17T04:34:53.079953+0000","last_peered":"2024-09-17T04:34:53.079953+0000","last_clean":"2024-09-17T04:34:53.079953+0000","last_became_active":"2024-09-17T04:34:51.077872+0000","last_became_peered":"2024-09-17T04:34:51.077872+0000","last_unstale":"2024-09-17T04:34:53.079953+0000","last_undegraded":"2024-09-17T04:34:53.079953+0000","last_fullsized":"2024-09-17T04:34:53.079953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:38.304333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315510+0000","last_change":"2024-09-17T04:34:52.084955+0000","last_active":"2024-09-17T04:34:53.315510+0000","last_peered":"2024-09-17T04:34:53.315510+0000","last_clean":"2024-09-17T04:34:53.315510+0000","last_became_active":"2024-09-17T04:34:52.084559+0000","last_became_peered":"2024-09-17T04:34:52.084559+0000","last_unstale":"2024-09-17T04:34:53.315510+0000","last_undegraded":"2024-09-17T04:34:53.315510+0000","last_fullsized":"2024-09-17T04:34:53.315510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:28.901357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177427+0000","last_change":"2024-09-17T04:34:51.073959+0000","last_active":"2024-09-17T04:34:53.177427+0000","last_peered":"2024-09-17T04:34:53.177427+0000","last_clean":"2024-09-17T04:34:53.177427+0000","last_became_active":"2024-09-17T04:34:51.073496+0000","last_became_peered":"2024-09-17T04:34:51.073496+0000","last_unstale":"2024-09-17T04:34:53.177427+0000","last_undegraded":"2024-09-17T04:34:53.177427+0000","last_fullsized":"2024-09-17T04:34:53.177427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:23.001571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177328+0000","last_change":"2024-09-17T04:34:52.081971+0000","last_active":"2024-09-17T04:34:53.177328+0000","last_peered":"2024-09-17T04:34:53.177328+0000","last_clean":"2024-09-17T04:34:53.177328+0000","last_became_active":"2024-09-17T04:34:52.081259+0000","last_became_peered":"2024-09-17T04:34:52.081259+0000","last_unstale":"2024-09-17T04:34:53.177328+0000","last_undegraded":"2024-09-17T04:34:53.177328+0000","last_fullsized":"2024-09-17T04:34:53.177328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:43.915741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315763+0000","last_change":"2024-09-17T04:34:51.070142+0000","last_active":"2024-09-17T04:34:53.315763+0000","last_peered":"2024-09-17T04:34:53.315763+0000","last_clean":"2024-09-17T04:34:53.315763+0000","last_became_active":"2024-09-17T04:34:51.069777+0000","last_became_peered":"2024-09-17T04:34:51.069777+0000","last_unstale":"2024-09-17T04:34:53.315763+0000","last_undegraded":"2024-09-17T04:34:53.315763+0000","last_fullsized":"2024-09-17T04:34:53.315763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:51.718064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476742,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":666914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":76546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476742,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":76546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476742,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":76546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":217088,"data_stored":76546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":217088,"data_stored":76546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":76546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":811008,"data_stored":666914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:34:58.508 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T04:34:58.509 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T04:34:58.509 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T04:34:58.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.663+0000 7efe6ff13640 1 -- 172.21.15.43:0/4246025153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680c4030 msgr2=0x7efe68071630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:58.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.663+0000 7efe6ff13640 1 --2- 172.21.15.43:0/4246025153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680c4030 0x7efe68071630 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efe68075690 tx=0x7efe5c02a5f0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.663+0000 7efe6ff13640 1 -- 172.21.15.43:0/4246025153 shutdown_connections 2024-09-17T04:34:58.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.663+0000 7efe6ff13640 1 --2- 172.21.15.43:0/4246025153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680c4030 0x7efe68071630 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.663+0000 7efe6ff13640 1 --2- 172.21.15.43:0/4246025153 >> v2:172.21.15.62:3300/0 conn(0x7efe680c4440 0x7efe68071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.663+0000 7efe6ff13640 1 --2- 172.21.15.43:0/4246025153 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe680c5f50 0x7efe68153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.663+0000 7efe6ff13640 1 -- 172.21.15.43:0/4246025153 >> 172.21.15.43:0/4246025153 conn(0x7efe68072f60 msgr2=0x7efe680cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:58.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.663+0000 7efe6ff13640 1 -- 172.21.15.43:0/4246025153 shutdown_connections 2024-09-17T04:34:58.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.663+0000 7efe6ff13640 1 -- 172.21.15.43:0/4246025153 wait complete. 2024-09-17T04:34:58.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.665+0000 7efe6ff13640 1 Processor -- start 2024-09-17T04:34:58.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.665+0000 7efe6ff13640 1 -- start start 2024-09-17T04:34:58.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.666+0000 7efe6ff13640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe680c4030 0x7efe681f3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:58.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.666+0000 7efe6ff13640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe680c4440 0x7efe680c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:58.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.666+0000 7efe6ff13640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680c5f50 0x7efe680c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:58.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.666+0000 7efe6ff13640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efe680c9a10 con 0x7efe680c5f50 2024-09-17T04:34:58.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.666+0000 7efe6ff13640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efe6815db10 con 0x7efe680c4030 2024-09-17T04:34:58.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.666+0000 7efe6ff13640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7efe68070280 con 0x7efe680c4440 2024-09-17T04:34:58.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.666+0000 7efe6e4b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680c5f50 0x7efe680c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:58.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.666+0000 7efe6e4b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680c5f50 0x7efe680c7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41634/0 (socket says 172.21.15.43:41634) 2024-09-17T04:34:58.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.666+0000 7efe6e4b0640 1 -- 172.21.15.43:0/1628563487 learned_addr learned my addr 172.21.15.43:0/1628563487 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:58.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.666+0000 7efe6dcaf640 1 --2- 172.21.15.43:0/1628563487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe680c4030 0x7efe681f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:58.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.666+0000 7efe6d4ae640 1 --2- 172.21.15.43:0/1628563487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe680c4440 0x7efe680c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:58.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.666+0000 7efe6e4b0640 1 -- 172.21.15.43:0/1628563487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe680c4440 msgr2=0x7efe680c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:58.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.666+0000 7efe6e4b0640 1 --2- 172.21.15.43:0/1628563487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe680c4440 0x7efe680c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.666+0000 7efe6e4b0640 1 -- 172.21.15.43:0/1628563487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe680c4030 msgr2=0x7efe681f3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:58.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.666+0000 7efe6e4b0640 1 --2- 172.21.15.43:0/1628563487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe680c4030 0x7efe681f3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.666+0000 7efe6e4b0640 1 -- 172.21.15.43:0/1628563487 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe681f3cb0 con 0x7efe680c5f50 2024-09-17T04:34:58.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.667+0000 7efe6e4b0640 1 --2- 172.21.15.43:0/1628563487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680c5f50 0x7efe680c7e90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efe6000d5e0 tx=0x7efe6000daa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:58.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.667+0000 7efe667fc640 1 -- 172.21.15.43:0/1628563487 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60017070 con 0x7efe680c5f50 2024-09-17T04:34:58.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.667+0000 7efe667fc640 1 -- 172.21.15.43:0/1628563487 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe60004330 con 0x7efe680c5f50 2024-09-17T04:34:58.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.667+0000 7efe667fc640 1 -- 172.21.15.43:0/1628563487 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe600099b0 con 0x7efe680c5f50 2024-09-17T04:34:58.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.667+0000 7efe6ff13640 1 -- 172.21.15.43:0/1628563487 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe681f0730 con 0x7efe680c5f50 2024-09-17T04:34:58.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.667+0000 7efe6ff13640 1 -- 172.21.15.43:0/1628563487 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe6815c710 con 0x7efe680c5f50 2024-09-17T04:34:58.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.668+0000 7efe6ff13640 1 -- 172.21.15.43:0/1628563487 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe68153a50 con 0x7efe680c5f50 2024-09-17T04:34:58.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.669+0000 7efe667fc640 1 -- 172.21.15.43:0/1628563487 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efe60009b50 con 0x7efe680c5f50 2024-09-17T04:34:58.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.669+0000 7efe667fc640 1 --2- 172.21.15.43:0/1628563487 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7efe54078b90 0x7efe5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:58.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.669+0000 7efe667fc640 1 -- 172.21.15.43:0/1628563487 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7efe6009aca0 con 0x7efe680c5f50 2024-09-17T04:34:58.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.670+0000 7efe6dcaf640 1 --2- 172.21.15.43:0/1628563487 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7efe54078b90 0x7efe5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:58.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.670+0000 7efe6dcaf640 1 --2- 172.21.15.43:0/1628563487 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7efe54078b90 0x7efe5407b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe58005fd0 tx=0x7efe58009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:58.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.674+0000 7efe667fc640 1 -- 172.21.15.43:0/1628563487 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efe60062bb0 con 0x7efe680c5f50 2024-09-17T04:34:58.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.862+0000 7efe6ff13640 1 -- 172.21.15.43:0/1628563487 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7efe6814f8d0 con 0x7efe680c5f50 2024-09-17T04:34:58.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.862+0000 7efe667fc640 1 -- 172.21.15.43:0/1628563487 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v36) ==== 86+0+160 (secure 0 0 0) 0x7efe600675e0 con 0x7efe680c5f50 2024-09-17T04:34:58.862 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:34:58.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.864+0000 7efe6ff13640 1 -- 172.21.15.43:0/1628563487 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7efe54078b90 msgr2=0x7efe5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:58.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.864+0000 7efe6ff13640 1 --2- 172.21.15.43:0/1628563487 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7efe54078b90 0x7efe5407b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe58005fd0 tx=0x7efe58009500 comp rx=0 tx=0).stop 2024-09-17T04:34:58.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.864+0000 7efe6ff13640 1 -- 172.21.15.43:0/1628563487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680c5f50 msgr2=0x7efe680c7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:58.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.864+0000 7efe6ff13640 1 --2- 172.21.15.43:0/1628563487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680c5f50 0x7efe680c7e90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efe6000d5e0 tx=0x7efe6000daa0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.865+0000 7efe6ff13640 1 -- 172.21.15.43:0/1628563487 shutdown_connections 2024-09-17T04:34:58.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.865+0000 7efe6ff13640 1 --2- 172.21.15.43:0/1628563487 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7efe54078b90 0x7efe5407b0a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.865+0000 7efe6ff13640 1 --2- 172.21.15.43:0/1628563487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680c5f50 0x7efe680c7e90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.865+0000 7efe6ff13640 1 --2- 172.21.15.43:0/1628563487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe680c4440 0x7efe680c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.865+0000 7efe6ff13640 1 --2- 172.21.15.43:0/1628563487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe680c4030 0x7efe681f3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.865+0000 7efe6ff13640 1 -- 172.21.15.43:0/1628563487 >> 172.21.15.43:0/1628563487 conn(0x7efe68072f60 msgr2=0x7efe68149b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:58.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.865+0000 7efe6ff13640 1 -- 172.21.15.43:0/1628563487 shutdown_connections 2024-09-17T04:34:58.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.865+0000 7efe6ff13640 1 -- 172.21.15.43:0/1628563487 wait complete. 2024-09-17T04:34:58.875 INFO:teuthology.orchestra.run.smithi043.stdout:[{"version":36,"timestamp":"2024-09-17T04:34:39.810280+0000","name":"","changes":[{"name":"osd.5/osd_mclock_max_capacity_iops_ssd","new_value":"4566.216384"}]}] 2024-09-17T04:34:58.876 INFO:tasks.ceph_manager:config epoch is 36 2024-09-17T04:34:58.876 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T04:34:58.876 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T04:34:58.876 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T04:34:58.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.994+0000 7f401da63640 1 -- 172.21.15.43:0/1932666065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40180c69b0 msgr2=0x7f40181672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:58.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.994+0000 7f401da63640 1 --2- 172.21.15.43:0/1932666065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40180c69b0 0x7f40181672e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f40180c80b0 tx=0x7f401002a8b0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.994+0000 7f401da63640 1 -- 172.21.15.43:0/1932666065 shutdown_connections 2024-09-17T04:34:58.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.994+0000 7f401da63640 1 --2- 172.21.15.43:0/1932666065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40180c69b0 0x7f40181672e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.994+0000 7f401da63640 1 -- 172.21.15.43:0/1932666065 >> 172.21.15.43:0/1932666065 conn(0x7f401806f460 msgr2=0x7f401806f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:58.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.994+0000 7f401da63640 1 -- 172.21.15.43:0/1932666065 shutdown_connections 2024-09-17T04:34:58.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.994+0000 7f401da63640 1 -- 172.21.15.43:0/1932666065 wait complete. 2024-09-17T04:34:58.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.996+0000 7f401da63640 1 Processor -- start 2024-09-17T04:34:58.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.996+0000 7f401da63640 1 -- start start 2024-09-17T04:34:58.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.997+0000 7f401da63640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40180c69b0 0x7f401815da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:58.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.997+0000 7f401da63640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40180c6f00 0x7f4018150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:58.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.997+0000 7f401da63640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4018155d40 0x7f40180d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:58.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.997+0000 7f401da63640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f40180c7730 con 0x7f40180c6f00 2024-09-17T04:34:58.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.997+0000 7f401da63640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f40180c7aa0 con 0x7f4018155d40 2024-09-17T04:34:58.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.997+0000 7f401da63640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f40180b4d50 con 0x7f40180c69b0 2024-09-17T04:34:58.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.997+0000 7f400ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40180c6f00 0x7f4018150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:58.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.997+0000 7f400ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40180c6f00 0x7f4018150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41644/0 (socket says 172.21.15.43:41644) 2024-09-17T04:34:58.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.997+0000 7f400ffff640 1 -- 172.21.15.43:0/3522005202 learned_addr learned my addr 172.21.15.43:0/3522005202 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:58.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.997+0000 7f4017fff640 1 --2- 172.21.15.43:0/3522005202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4018155d40 0x7f40180d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:58.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.997+0000 7f40177fe640 1 --2- 172.21.15.43:0/3522005202 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40180c69b0 0x7f401815da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:58.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.997+0000 7f400ffff640 1 -- 172.21.15.43:0/3522005202 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40180c69b0 msgr2=0x7f401815da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:58.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.997+0000 7f400ffff640 1 --2- 172.21.15.43:0/3522005202 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40180c69b0 0x7f401815da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.997+0000 7f400ffff640 1 -- 172.21.15.43:0/3522005202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4018155d40 msgr2=0x7f40180d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:58.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.997+0000 7f400ffff640 1 --2- 172.21.15.43:0/3522005202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4018155d40 0x7f40180d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:58.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.997+0000 7f400ffff640 1 -- 172.21.15.43:0/3522005202 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401815dfb0 con 0x7f40180c6f00 2024-09-17T04:34:58.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.998+0000 7f400ffff640 1 --2- 172.21.15.43:0/3522005202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40180c6f00 0x7f4018150bd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f400000c500 tx=0x7f400000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:58.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.998+0000 7f4014ff9640 1 -- 172.21.15.43:0/3522005202 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000016020 con 0x7f40180c6f00 2024-09-17T04:34:59.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.998+0000 7f4014ff9640 1 -- 172.21.15.43:0/3522005202 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4000012920 con 0x7f40180c6f00 2024-09-17T04:34:59.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.998+0000 7f401da63640 1 -- 172.21.15.43:0/3522005202 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40181f60e0 con 0x7f40180c6f00 2024-09-17T04:34:59.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.998+0000 7f4014ff9640 1 -- 172.21.15.43:0/3522005202 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000012d30 con 0x7f40180c6f00 2024-09-17T04:34:59.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.998+0000 7f401da63640 1 -- 172.21.15.43:0/3522005202 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40181f5840 con 0x7f40180c6f00 2024-09-17T04:34:59.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:58.999+0000 7f401da63640 1 -- 172.21.15.43:0/3522005202 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40181f52d0 con 0x7f40180c6f00 2024-09-17T04:34:59.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.000+0000 7f4014ff9640 1 -- 172.21.15.43:0/3522005202 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4000019020 con 0x7f40180c6f00 2024-09-17T04:34:59.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.000+0000 7f4014ff9640 1 --2- 172.21.15.43:0/3522005202 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f3ff8078b90 0x7f3ff807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:59.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.000+0000 7f4014ff9640 1 -- 172.21.15.43:0/3522005202 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f400009a930 con 0x7f40180c6f00 2024-09-17T04:34:59.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.001+0000 7f40177fe640 1 --2- 172.21.15.43:0/3522005202 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f3ff8078b90 0x7f3ff807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:59.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.001+0000 7f40177fe640 1 --2- 172.21.15.43:0/3522005202 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f3ff8078b90 0x7f3ff807b0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4008001120 tx=0x7f4008009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:59.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.005+0000 7f4014ff9640 1 -- 172.21.15.43:0/3522005202 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4000020030 con 0x7f40180c6f00 2024-09-17T04:34:59.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.246+0000 7f401da63640 1 -- 172.21.15.43:0/3522005202 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f40180d1d90 con 0x7f40180c6f00 2024-09-17T04:34:59.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.249+0000 7f4014ff9640 1 -- 172.21.15.43:0/3522005202 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194713 (secure 0 0 0) 0x7f40000627c0 con 0x7f40180c6f00 2024-09-17T04:34:59.251 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:34:59.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.252+0000 7f401da63640 1 -- 172.21.15.43:0/3522005202 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f3ff8078b90 msgr2=0x7f3ff807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:59.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.252+0000 7f401da63640 1 --2- 172.21.15.43:0/3522005202 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f3ff8078b90 0x7f3ff807b0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4008001120 tx=0x7f4008009040 comp rx=0 tx=0).stop 2024-09-17T04:34:59.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.252+0000 7f401da63640 1 -- 172.21.15.43:0/3522005202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40180c6f00 msgr2=0x7f4018150bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:59.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.252+0000 7f401da63640 1 --2- 172.21.15.43:0/3522005202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40180c6f00 0x7f4018150bd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f400000c500 tx=0x7f400000c9c0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.252+0000 7f401da63640 1 -- 172.21.15.43:0/3522005202 shutdown_connections 2024-09-17T04:34:59.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.252+0000 7f401da63640 1 --2- 172.21.15.43:0/3522005202 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f3ff8078b90 0x7f3ff807b0a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.252+0000 7f401da63640 1 --2- 172.21.15.43:0/3522005202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4018155d40 0x7f40180d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.252+0000 7f401da63640 1 --2- 172.21.15.43:0/3522005202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40180c6f00 0x7f4018150bd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.252+0000 7f401da63640 1 --2- 172.21.15.43:0/3522005202 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40180c69b0 0x7f401815da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.252+0000 7f401da63640 1 -- 172.21.15.43:0/3522005202 >> 172.21.15.43:0/3522005202 conn(0x7f401806f460 msgr2=0x7f401815ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:59.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.252+0000 7f401da63640 1 -- 172.21.15.43:0/3522005202 shutdown_connections 2024-09-17T04:34:59.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.252+0000 7f401da63640 1 -- 172.21.15.43:0/3522005202 wait complete. 2024-09-17T04:34:59.263 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1186143747},{"type":"v1","addr":"172.21.15.62:6801","nonce":1186143747}]},"active_addr":"172.21.15.62:6801/1186143747","active_change":"2024-09-17T04:34:30.880741+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":428389359}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":2264295378}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":557445206}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":3037614748}]}]} 2024-09-17T04:34:59.268 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T04:34:59.268 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T04:34:59.268 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:34:59.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.385+0000 7f2c1056e640 1 -- 172.21.15.43:0/1523638906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c080cc530 msgr2=0x7f2c080cae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:59.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.385+0000 7f2c1056e640 1 --2- 172.21.15.43:0/1523638906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c080cc530 0x7f2c080cae70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2c0815b9d0 tx=0x7f2bf802aac0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.385+0000 7f2c1056e640 1 -- 172.21.15.43:0/1523638906 shutdown_connections 2024-09-17T04:34:59.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.385+0000 7f2c1056e640 1 --2- 172.21.15.43:0/1523638906 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2c080d18f0 0x7f2c0815bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.385+0000 7f2c1056e640 1 --2- 172.21.15.43:0/1523638906 >> v2:172.21.15.62:3300/0 conn(0x7f2c080b3f30 0x7f2c080d13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.385+0000 7f2c1056e640 1 --2- 172.21.15.43:0/1523638906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c080cc530 0x7f2c080cae70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.385+0000 7f2c1056e640 1 -- 172.21.15.43:0/1523638906 >> 172.21.15.43:0/1523638906 conn(0x7f2c0806f2a0 msgr2=0x7f2c0806f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:59.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.385+0000 7f2c1056e640 1 -- 172.21.15.43:0/1523638906 shutdown_connections 2024-09-17T04:34:59.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.385+0000 7f2c1056e640 1 -- 172.21.15.43:0/1523638906 wait complete. 2024-09-17T04:34:59.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.387+0000 7f2c1056e640 1 Processor -- start 2024-09-17T04:34:59.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.387+0000 7f2c1056e640 1 -- start start 2024-09-17T04:34:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.388+0000 7f2c1056e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c080b3f30 0x7f2c080c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.388+0000 7f2c1056e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c080cc530 0x7f2c0815bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.388+0000 7f2c1056e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2c080d18f0 0x7f2c08153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.388+0000 7f2c1056e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2c080b4e30 con 0x7f2c080cc530 2024-09-17T04:34:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.388+0000 7f2c1056e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0815f8a0 con 0x7f2c080b3f30 2024-09-17T04:34:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.388+0000 7f2c1056e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2c080cb3b0 con 0x7f2c080d18f0 2024-09-17T04:34:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.388+0000 7f2c0db09640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c080cc530 0x7f2c0815bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:59.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.388+0000 7f2c0db09640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c080cc530 0x7f2c0815bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41672/0 (socket says 172.21.15.43:41672) 2024-09-17T04:34:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.388+0000 7f2c0db09640 1 -- 172.21.15.43:0/2074055391 learned_addr learned my addr 172.21.15.43:0/2074055391 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.388+0000 7f2c0e30a640 1 --2- 172.21.15.43:0/2074055391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c080b3f30 0x7f2c080c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.388+0000 7f2c0eb0b640 1 --2- 172.21.15.43:0/2074055391 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2c080d18f0 0x7f2c08153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.388+0000 7f2c0db09640 1 -- 172.21.15.43:0/2074055391 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2c080d18f0 msgr2=0x7f2c08153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.388+0000 7f2c0db09640 1 --2- 172.21.15.43:0/2074055391 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2c080d18f0 0x7f2c08153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.388+0000 7f2c0db09640 1 -- 172.21.15.43:0/2074055391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c080b3f30 msgr2=0x7f2c080c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.388+0000 7f2c0db09640 1 --2- 172.21.15.43:0/2074055391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c080b3f30 0x7f2c080c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.388+0000 7f2c0db09640 1 -- 172.21.15.43:0/2074055391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0815e7a0 con 0x7f2c080cc530 2024-09-17T04:34:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.389+0000 7f2c0db09640 1 --2- 172.21.15.43:0/2074055391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c080cc530 0x7f2c0815bc90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00d660 tx=0x7f2bfc00db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.389+0000 7f2c06ffd640 1 -- 172.21.15.43:0/2074055391 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc017070 con 0x7f2c080cc530 2024-09-17T04:34:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.389+0000 7f2c06ffd640 1 -- 172.21.15.43:0/2074055391 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2bfc009b10 con 0x7f2c080cc530 2024-09-17T04:34:59.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.389+0000 7f2c1056e640 1 -- 172.21.15.43:0/2074055391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0815ea80 con 0x7f2c080cc530 2024-09-17T04:34:59.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.389+0000 7f2c06ffd640 1 -- 172.21.15.43:0/2074055391 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc010460 con 0x7f2c080cc530 2024-09-17T04:34:59.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.389+0000 7f2c1056e640 1 -- 172.21.15.43:0/2074055391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c081ebfa0 con 0x7f2c080cc530 2024-09-17T04:34:59.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.390+0000 7f2c1056e640 1 -- 172.21.15.43:0/2074055391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c080cc970 con 0x7f2c080cc530 2024-09-17T04:34:59.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.390+0000 7f2c06ffd640 1 -- 172.21.15.43:0/2074055391 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2bfc01a070 con 0x7f2c080cc530 2024-09-17T04:34:59.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.391+0000 7f2c06ffd640 1 --2- 172.21.15.43:0/2074055391 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f2bf4078bc0 0x7f2bf407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:59.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.391+0000 7f2c06ffd640 1 -- 172.21.15.43:0/2074055391 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2bfc09adb0 con 0x7f2c080cc530 2024-09-17T04:34:59.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.392+0000 7f2c0e30a640 1 --2- 172.21.15.43:0/2074055391 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f2bf4078bc0 0x7f2bf407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:59.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.392+0000 7f2c0e30a640 1 --2- 172.21.15.43:0/2074055391 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f2bf4078bc0 0x7f2bf407b0d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8035000 tx=0x7f2bf8038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:59.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.395+0000 7f2c06ffd640 1 -- 172.21.15.43:0/2074055391 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2bfc09f070 con 0x7f2c080cc530 2024-09-17T04:34:59.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.582+0000 7f2c1056e640 1 -- 172.21.15.43:0/2074055391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c080c4ed0 con 0x7f2c080cc530 2024-09-17T04:34:59.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.583+0000 7f2c06ffd640 1 -- 172.21.15.43:0/2074055391 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16641 (secure 0 0 0) 0x7f2bfc062b90 con 0x7f2c080cc530 2024-09-17T04:34:59.583 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:34:59.583 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":22,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","created":"2024-09-17T04:34:26.485007+0000","modified":"2024-09-17T04:34:53.066747+0000","last_up_change":"2024-09-17T04:34:40.712497+0000","last_in_change":"2024-09-17T04:34:30.384271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:34:38.905735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:34:49.341236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:34:50.401489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eaab925a-60b4-429f-aee1-50de6f32358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6817","nonce":1685480205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6819","nonce":1685480205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6823","nonce":1685480205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6821","nonce":1685480205}]},"public_addr":"172.21.15.43:6817/1685480205","cluster_addr":"172.21.15.43:6819/1685480205","heartbeat_back_addr":"172.21.15.43:6823/1685480205","heartbeat_front_addr":"172.21.15.43:6821/1685480205","state":["exists","up"]},{"osd":1,"uuid":"2c0e64be-db05-45db-aad8-2f2f42812100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6825","nonce":1564354446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6827","nonce":1564354446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6831","nonce":1564354446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6829","nonce":1564354446}]},"public_addr":"172.21.15.43:6825/1564354446","cluster_addr":"172.21.15.43:6827/1564354446","heartbeat_back_addr":"172.21.15.43:6831/1564354446","heartbeat_front_addr":"172.21.15.43:6829/1564354446","state":["exists","up"]},{"osd":2,"uuid":"fa88665d-2acb-4e44-99ac-1d496adf5b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6801","nonce":1385342605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6803","nonce":1385342605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6807","nonce":1385342605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6805","nonce":1385342605}]},"public_addr":"172.21.15.43:6801/1385342605","cluster_addr":"172.21.15.43:6803/1385342605","heartbeat_back_addr":"172.21.15.43:6807/1385342605","heartbeat_front_addr":"172.21.15.43:6805/1385342605","state":["exists","up"]},{"osd":3,"uuid":"710a28f0-d04a-4b4a-bba3-28f7c7b1eb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6809","nonce":1646004903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6811","nonce":1646004903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6815","nonce":1646004903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6813","nonce":1646004903}]},"public_addr":"172.21.15.43:6809/1646004903","cluster_addr":"172.21.15.43:6811/1646004903","heartbeat_back_addr":"172.21.15.43:6815/1646004903","heartbeat_front_addr":"172.21.15.43:6813/1646004903","state":["exists","up"]},{"osd":4,"uuid":"d2eca96b-1917-4dbb-b6e3-f4410bbc5c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6803","nonce":3991694106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6805","nonce":3991694106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6809","nonce":3991694106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6807","nonce":3991694106}]},"public_addr":"172.21.15.62:6803/3991694106","cluster_addr":"172.21.15.62:6805/3991694106","heartbeat_back_addr":"172.21.15.62:6809/3991694106","heartbeat_front_addr":"172.21.15.62:6807/3991694106","state":["exists","up"]},{"osd":5,"uuid":"ae843bea-38ff-4ca6-a7a9-6e58c7a17fd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6827","nonce":2558615114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6829","nonce":2558615114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6833","nonce":2558615114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6831","nonce":2558615114}]},"public_addr":"172.21.15.62:6827/2558615114","cluster_addr":"172.21.15.62:6829/2558615114","heartbeat_back_addr":"172.21.15.62:6833/2558615114","heartbeat_front_addr":"172.21.15.62:6831/2558615114","state":["exists","up"]},{"osd":6,"uuid":"44c53356-010d-443f-9e8d-f0d5da106893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6811","nonce":1901653154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6813","nonce":1901653154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6817","nonce":1901653154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6815","nonce":1901653154}]},"public_addr":"172.21.15.62:6811/1901653154","cluster_addr":"172.21.15.62:6813/1901653154","heartbeat_back_addr":"172.21.15.62:6817/1901653154","heartbeat_front_addr":"172.21.15.62:6815/1901653154","state":["exists","up"]},{"osd":7,"uuid":"c8960d11-dd10-4e36-b9d8-f1fdc0abe9c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6819","nonce":2974376041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6821","nonce":2974376041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6825","nonce":2974376041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6823","nonce":2974376041}]},"public_addr":"172.21.15.62:6819/2974376041","cluster_addr":"172.21.15.62:6821/2974376041","heartbeat_back_addr":"172.21.15.62:6825/2974376041","heartbeat_front_addr":"172.21.15.62:6823/2974376041","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.435063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.372079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:35.973575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.690029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.944690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.691776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.877497+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.689786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:34:59.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.586+0000 7f2c1056e640 1 -- 172.21.15.43:0/2074055391 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f2bf4078bc0 msgr2=0x7f2bf407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:59.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.586+0000 7f2c1056e640 1 --2- 172.21.15.43:0/2074055391 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f2bf4078bc0 0x7f2bf407b0d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8035000 tx=0x7f2bf8038040 comp rx=0 tx=0).stop 2024-09-17T04:34:59.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.586+0000 7f2c1056e640 1 -- 172.21.15.43:0/2074055391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c080cc530 msgr2=0x7f2c0815bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:59.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.586+0000 7f2c1056e640 1 --2- 172.21.15.43:0/2074055391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c080cc530 0x7f2c0815bc90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00d660 tx=0x7f2bfc00db20 comp rx=0 tx=0).stop 2024-09-17T04:34:59.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.586+0000 7f2c1056e640 1 -- 172.21.15.43:0/2074055391 shutdown_connections 2024-09-17T04:34:59.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.586+0000 7f2c1056e640 1 --2- 172.21.15.43:0/2074055391 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f2bf4078bc0 0x7f2bf407b0d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.586+0000 7f2c1056e640 1 --2- 172.21.15.43:0/2074055391 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2c080d18f0 0x7f2c08153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.586+0000 7f2c1056e640 1 --2- 172.21.15.43:0/2074055391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c080cc530 0x7f2c0815bc90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.586+0000 7f2c1056e640 1 --2- 172.21.15.43:0/2074055391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c080b3f30 0x7f2c080c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.586+0000 7f2c1056e640 1 -- 172.21.15.43:0/2074055391 >> 172.21.15.43:0/2074055391 conn(0x7f2c0806f2a0 msgr2=0x7f2c081555a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:59.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.586+0000 7f2c1056e640 1 -- 172.21.15.43:0/2074055391 shutdown_connections 2024-09-17T04:34:59.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.586+0000 7f2c1056e640 1 -- 172.21.15.43:0/2074055391 wait complete. 2024-09-17T04:34:59.597 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T04:34:59.597 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:34:59.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.714+0000 7f235e501640 1 -- 172.21.15.43:0/3524037410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580c4440 msgr2=0x7f2358070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:59.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.714+0000 7f235e501640 1 --2- 172.21.15.43:0/3524037410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580c4440 0x7f2358070280 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2350005fd0 tx=0x7f235002a8d0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.714+0000 7f235e501640 1 -- 172.21.15.43:0/3524037410 shutdown_connections 2024-09-17T04:34:59.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.714+0000 7f235e501640 1 --2- 172.21.15.43:0/3524037410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580c4440 0x7f2358070280 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.714+0000 7f235e501640 1 --2- 172.21.15.43:0/3524037410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23580c5f50 0x7f2358153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.714+0000 7f235e501640 1 -- 172.21.15.43:0/3524037410 >> 172.21.15.43:0/3524037410 conn(0x7f2358072f60 msgr2=0x7f23580cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:59.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.714+0000 7f235e501640 1 -- 172.21.15.43:0/3524037410 shutdown_connections 2024-09-17T04:34:59.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.714+0000 7f235e501640 1 -- 172.21.15.43:0/3524037410 wait complete. 2024-09-17T04:34:59.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.715+0000 7f235e501640 1 Processor -- start 2024-09-17T04:34:59.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.716+0000 7f235e501640 1 -- start start 2024-09-17T04:34:59.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.717+0000 7f235e501640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23580c4030 0x7f23581f2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:59.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.717+0000 7f235e501640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580c4440 0x7f23580c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:59.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.717+0000 7f235e501640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23580c5f50 0x7f2358144b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:59.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.717+0000 7f235e501640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f23580c9a10 con 0x7f23580c5f50 2024-09-17T04:34:59.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.717+0000 7f235e501640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f235815db10 con 0x7f23580c4440 2024-09-17T04:34:59.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.717+0000 7f235e501640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2358071d40 con 0x7f23580c4030 2024-09-17T04:34:59.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.717+0000 7f235ca9e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23580c5f50 0x7f2358144b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:59.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.717+0000 7f235ca9e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23580c5f50 0x7f2358144b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41684/0 (socket says 172.21.15.43:41684) 2024-09-17T04:34:59.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.717+0000 7f235ca9e640 1 -- 172.21.15.43:0/2312342696 learned_addr learned my addr 172.21.15.43:0/2312342696 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:34:59.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.717+0000 7f2357fff640 1 --2- 172.21.15.43:0/2312342696 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23580c4030 0x7f23581f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:59.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.717+0000 7f23577fe640 1 --2- 172.21.15.43:0/2312342696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580c4440 0x7f23580c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:59.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.717+0000 7f235ca9e640 1 -- 172.21.15.43:0/2312342696 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23580c4030 msgr2=0x7f23581f2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:59.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.717+0000 7f235ca9e640 1 --2- 172.21.15.43:0/2312342696 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23580c4030 0x7f23581f2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.717+0000 7f235ca9e640 1 -- 172.21.15.43:0/2312342696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580c4440 msgr2=0x7f23580c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:59.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.717+0000 7f235ca9e640 1 --2- 172.21.15.43:0/2312342696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580c4440 0x7f23580c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.717+0000 7f235ca9e640 1 -- 172.21.15.43:0/2312342696 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23581f3320 con 0x7f23580c5f50 2024-09-17T04:34:59.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.718+0000 7f235ca9e640 1 --2- 172.21.15.43:0/2312342696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23580c5f50 0x7f2358144b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2350009cd0 tx=0x7f2350032f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:59.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.718+0000 7f2354ff9640 1 -- 172.21.15.43:0/2312342696 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350037040 con 0x7f23580c5f50 2024-09-17T04:34:59.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.718+0000 7f2354ff9640 1 -- 172.21.15.43:0/2312342696 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2350003c60 con 0x7f23580c5f50 2024-09-17T04:34:59.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.718+0000 7f235e501640 1 -- 172.21.15.43:0/2312342696 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23580c6410 con 0x7f23580c5f50 2024-09-17T04:34:59.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.718+0000 7f2354ff9640 1 -- 172.21.15.43:0/2312342696 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235003c990 con 0x7f23580c5f50 2024-09-17T04:34:59.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.718+0000 7f235e501640 1 -- 172.21.15.43:0/2312342696 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23580c69b0 con 0x7f23580c5f50 2024-09-17T04:34:59.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.719+0000 7f235e501640 1 -- 172.21.15.43:0/2312342696 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f235815c910 con 0x7f23580c5f50 2024-09-17T04:34:59.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.720+0000 7f2354ff9640 1 -- 172.21.15.43:0/2312342696 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f235003a070 con 0x7f23580c5f50 2024-09-17T04:34:59.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.720+0000 7f2354ff9640 1 --2- 172.21.15.43:0/2312342696 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f2344078bc0 0x7f234407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:34:59.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.720+0000 7f2354ff9640 1 -- 172.21.15.43:0/2312342696 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f23500bbb40 con 0x7f23580c5f50 2024-09-17T04:34:59.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.720+0000 7f2357fff640 1 --2- 172.21.15.43:0/2312342696 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f2344078bc0 0x7f234407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:34:59.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.721+0000 7f2357fff640 1 --2- 172.21.15.43:0/2312342696 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f2344078bc0 0x7f234407b0d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2348009b30 tx=0x7f2348005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:34:59.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.725+0000 7f2354ff9640 1 -- 172.21.15.43:0/2312342696 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f235815c910 con 0x7f23580c5f50 2024-09-17T04:34:59.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.909+0000 7f235e501640 1 -- 172.21.15.43:0/2312342696 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2358153a50 con 0x7f23580c5f50 2024-09-17T04:34:59.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.910+0000 7f2354ff9640 1 -- 172.21.15.43:0/2312342696 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16641 (secure 0 0 0) 0x7f2350041020 con 0x7f23580c5f50 2024-09-17T04:34:59.911 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:34:59.911 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":22,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","created":"2024-09-17T04:34:26.485007+0000","modified":"2024-09-17T04:34:53.066747+0000","last_up_change":"2024-09-17T04:34:40.712497+0000","last_in_change":"2024-09-17T04:34:30.384271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:34:38.905735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:34:49.341236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:34:50.401489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eaab925a-60b4-429f-aee1-50de6f32358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6817","nonce":1685480205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6819","nonce":1685480205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6823","nonce":1685480205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6821","nonce":1685480205}]},"public_addr":"172.21.15.43:6817/1685480205","cluster_addr":"172.21.15.43:6819/1685480205","heartbeat_back_addr":"172.21.15.43:6823/1685480205","heartbeat_front_addr":"172.21.15.43:6821/1685480205","state":["exists","up"]},{"osd":1,"uuid":"2c0e64be-db05-45db-aad8-2f2f42812100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6825","nonce":1564354446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6827","nonce":1564354446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6831","nonce":1564354446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6829","nonce":1564354446}]},"public_addr":"172.21.15.43:6825/1564354446","cluster_addr":"172.21.15.43:6827/1564354446","heartbeat_back_addr":"172.21.15.43:6831/1564354446","heartbeat_front_addr":"172.21.15.43:6829/1564354446","state":["exists","up"]},{"osd":2,"uuid":"fa88665d-2acb-4e44-99ac-1d496adf5b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6801","nonce":1385342605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6803","nonce":1385342605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6807","nonce":1385342605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6805","nonce":1385342605}]},"public_addr":"172.21.15.43:6801/1385342605","cluster_addr":"172.21.15.43:6803/1385342605","heartbeat_back_addr":"172.21.15.43:6807/1385342605","heartbeat_front_addr":"172.21.15.43:6805/1385342605","state":["exists","up"]},{"osd":3,"uuid":"710a28f0-d04a-4b4a-bba3-28f7c7b1eb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6809","nonce":1646004903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6811","nonce":1646004903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6815","nonce":1646004903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6813","nonce":1646004903}]},"public_addr":"172.21.15.43:6809/1646004903","cluster_addr":"172.21.15.43:6811/1646004903","heartbeat_back_addr":"172.21.15.43:6815/1646004903","heartbeat_front_addr":"172.21.15.43:6813/1646004903","state":["exists","up"]},{"osd":4,"uuid":"d2eca96b-1917-4dbb-b6e3-f4410bbc5c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6803","nonce":3991694106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6805","nonce":3991694106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6809","nonce":3991694106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6807","nonce":3991694106}]},"public_addr":"172.21.15.62:6803/3991694106","cluster_addr":"172.21.15.62:6805/3991694106","heartbeat_back_addr":"172.21.15.62:6809/3991694106","heartbeat_front_addr":"172.21.15.62:6807/3991694106","state":["exists","up"]},{"osd":5,"uuid":"ae843bea-38ff-4ca6-a7a9-6e58c7a17fd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6827","nonce":2558615114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6829","nonce":2558615114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6833","nonce":2558615114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6831","nonce":2558615114}]},"public_addr":"172.21.15.62:6827/2558615114","cluster_addr":"172.21.15.62:6829/2558615114","heartbeat_back_addr":"172.21.15.62:6833/2558615114","heartbeat_front_addr":"172.21.15.62:6831/2558615114","state":["exists","up"]},{"osd":6,"uuid":"44c53356-010d-443f-9e8d-f0d5da106893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6811","nonce":1901653154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6813","nonce":1901653154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6817","nonce":1901653154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6815","nonce":1901653154}]},"public_addr":"172.21.15.62:6811/1901653154","cluster_addr":"172.21.15.62:6813/1901653154","heartbeat_back_addr":"172.21.15.62:6817/1901653154","heartbeat_front_addr":"172.21.15.62:6815/1901653154","state":["exists","up"]},{"osd":7,"uuid":"c8960d11-dd10-4e36-b9d8-f1fdc0abe9c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6819","nonce":2974376041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6821","nonce":2974376041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6825","nonce":2974376041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6823","nonce":2974376041}]},"public_addr":"172.21.15.62:6819/2974376041","cluster_addr":"172.21.15.62:6821/2974376041","heartbeat_back_addr":"172.21.15.62:6825/2974376041","heartbeat_front_addr":"172.21.15.62:6823/2974376041","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.435063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.372079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:35.973575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.690029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.944690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.691776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.877497+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.689786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:34:59.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.912+0000 7f235e501640 1 -- 172.21.15.43:0/2312342696 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f2344078bc0 msgr2=0x7f234407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:59.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.912+0000 7f235e501640 1 --2- 172.21.15.43:0/2312342696 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f2344078bc0 0x7f234407b0d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2348009b30 tx=0x7f2348005f90 comp rx=0 tx=0).stop 2024-09-17T04:34:59.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.912+0000 7f235e501640 1 -- 172.21.15.43:0/2312342696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23580c5f50 msgr2=0x7f2358144b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:34:59.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.912+0000 7f235e501640 1 --2- 172.21.15.43:0/2312342696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23580c5f50 0x7f2358144b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2350009cd0 tx=0x7f2350032f30 comp rx=0 tx=0).stop 2024-09-17T04:34:59.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.913+0000 7f235e501640 1 -- 172.21.15.43:0/2312342696 shutdown_connections 2024-09-17T04:34:59.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.913+0000 7f235e501640 1 --2- 172.21.15.43:0/2312342696 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f2344078bc0 0x7f234407b0d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.913+0000 7f235e501640 1 --2- 172.21.15.43:0/2312342696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580c4440 0x7f23580c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.913+0000 7f235e501640 1 --2- 172.21.15.43:0/2312342696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23580c5f50 0x7f2358144b20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.913+0000 7f235e501640 1 --2- 172.21.15.43:0/2312342696 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23580c4030 0x7f23581f2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:34:59.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.913+0000 7f235e501640 1 -- 172.21.15.43:0/2312342696 >> 172.21.15.43:0/2312342696 conn(0x7f2358072f60 msgr2=0x7f23580caec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:34:59.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.913+0000 7f235e501640 1 -- 172.21.15.43:0/2312342696 shutdown_connections 2024-09-17T04:34:59.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:34:59.913+0000 7f235e501640 1 -- 172.21.15.43:0/2312342696 wait complete. 2024-09-17T04:34:59.924 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T04:34:59.924 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T04:34:59.925 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T04:34:59.925 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T04:34:59.926 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T04:34:59.926 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T04:34:59.926 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T04:34:59.927 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T04:35:00.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.152+0000 7fe1dc03f640 1 -- 172.21.15.43:0/4019388817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1d4151210 msgr2=0x7fe1d4151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.152+0000 7fe1dc03f640 1 --2- 172.21.15.43:0/4019388817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1d4151210 0x7fe1d4151620 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4071e90 tx=0x7fe1cc02aa30 comp rx=0 tx=0).stop 2024-09-17T04:35:00.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.153+0000 7fe1dc03f640 1 -- 172.21.15.43:0/4019388817 shutdown_connections 2024-09-17T04:35:00.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.153+0000 7fe1dc03f640 1 --2- 172.21.15.43:0/4019388817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1d4151210 0x7fe1d4151620 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.153+0000 7fe1dc03f640 1 --2- 172.21.15.43:0/4019388817 >> v2:172.21.15.62:3300/0 conn(0x7fe1d40c3a80 0x7fe1d415c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.153+0000 7fe1dc03f640 1 -- 172.21.15.43:0/4019388817 >> 172.21.15.43:0/4019388817 conn(0x7fe1d4070540 msgr2=0x7fe1d4070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.154+0000 7fe1dc03f640 1 -- 172.21.15.43:0/4019388817 shutdown_connections 2024-09-17T04:35:00.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.154+0000 7fe1dc03f640 1 -- 172.21.15.43:0/4019388817 wait complete. 2024-09-17T04:35:00.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.156+0000 7fe886ffd640 1 -- 172.21.15.43:0/2902910769 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8780047a0 con 0x7fe888072740 2024-09-17T04:35:00.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.157+0000 7fe1dc03f640 1 Processor -- start 2024-09-17T04:35:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7ff523fff640 1 -- 172.21.15.43:0/2056504827 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528006b30 con 0x7ff518003b90 2024-09-17T04:35:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7f66fffff640 1 -- 172.21.15.43:0/1181896356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67000cccb0 msgr2=0x7f67000d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7fe88ea55640 1 -- 172.21.15.43:0/2902910769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe888072740 msgr2=0x7fe888154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7fe88ea55640 1 --2- 172.21.15.43:0/2902910769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe888072740 0x7fe888154d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe8880716e0 tx=0x7fe87802a440 comp rx=0 tx=0).stop 2024-09-17T04:35:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7f66fffff640 1 --2- 172.21.15.43:0/1181896356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67000cccb0 0x7f67000d12c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009830 tx=0x7f66f402a5b0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7ff53234b640 1 -- 172.21.15.43:0/2056504827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff518003b90 msgr2=0x7ff518003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7ff53234b640 1 --2- 172.21.15.43:0/2056504827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff518003b90 0x7ff518003fc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff528006f10 tx=0x7ff518005830 comp rx=0 tx=0).stop 2024-09-17T04:35:00.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7f66fffff640 1 -- 172.21.15.43:0/1181896356 shutdown_connections 2024-09-17T04:35:00.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7f66fffff640 1 --2- 172.21.15.43:0/1181896356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67000cccb0 0x7f67000d12c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7f66fffff640 1 --2- 172.21.15.43:0/1181896356 >> v2:172.21.15.43:3300/0 conn(0x7f670015ebd0 0x7f6700155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7f66fffff640 1 -- 172.21.15.43:0/1181896356 >> 172.21.15.43:0/1181896356 conn(0x7f670006f0e0 msgr2=0x7f670006f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7fe88ea55640 1 -- 172.21.15.43:0/2902910769 shutdown_connections 2024-09-17T04:35:00.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7fe88ea55640 1 --2- 172.21.15.43:0/2902910769 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8880c8040 0x7fe8880c31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7fe88ea55640 1 --2- 172.21.15.43:0/2902910769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe888072740 0x7fe888154d80 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe8880716e0 tx=0x7fe87802a440 comp rx=0 tx=0).stop 2024-09-17T04:35:00.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7fe88ea55640 1 -- 172.21.15.43:0/2902910769 >> 172.21.15.43:0/2902910769 conn(0x7fe888070540 msgr2=0x7fe888070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7ff53234b640 1 -- 172.21.15.43:0/2056504827 shutdown_connections 2024-09-17T04:35:00.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7ff53234b640 1 --2- 172.21.15.43:0/2056504827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff518003b90 0x7ff518003fc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.158+0000 7ff53234b640 1 -- 172.21.15.43:0/2056504827 >> 172.21.15.43:0/2056504827 conn(0x7ff524050fa0 msgr2=0x7ff5240513b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.157+0000 7fe1dc03f640 1 -- start start 2024-09-17T04:35:00.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.159+0000 7ff53234b640 1 -- 172.21.15.43:0/2056504827 shutdown_connections 2024-09-17T04:35:00.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.159+0000 7fe88ea55640 1 -- 172.21.15.43:0/2902910769 shutdown_connections 2024-09-17T04:35:00.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.159+0000 7ff53234b640 1 -- 172.21.15.43:0/2056504827 wait complete. 2024-09-17T04:35:00.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.159+0000 7fe88ea55640 1 -- 172.21.15.43:0/2902910769 wait complete. 2024-09-17T04:35:00.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.159+0000 7f66fffff640 1 -- 172.21.15.43:0/1181896356 shutdown_connections 2024-09-17T04:35:00.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.159+0000 7fe1dc03f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1d406ddc0 0x7fe1d415c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.159+0000 7f66fffff640 1 -- 172.21.15.43:0/1181896356 wait complete. 2024-09-17T04:35:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.160+0000 7fe1dc03f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1d40c3a80 0x7fe1d40c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.160+0000 7fe1d9ddb640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1d406ddc0 0x7fe1d415c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.160+0000 7fe1d9ddb640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1d406ddc0 0x7fe1d415c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:59924/0 (socket says 172.21.15.43:59924) 2024-09-17T04:35:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.160+0000 7fe1d9ddb640 1 -- 172.21.15.43:0/1637066767 learned_addr learned my addr 172.21.15.43:0/1637066767 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.160+0000 7fe1dc03f640 1 --2- 172.21.15.43:0/1637066767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d4151210 0x7fe1d40ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.160+0000 7fe1dc03f640 1 -- 172.21.15.43:0/1637066767 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d40c9240 con 0x7fe1d40c3a80 2024-09-17T04:35:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.160+0000 7fe1dc03f640 1 -- 172.21.15.43:0/1637066767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d415b980 con 0x7fe1d4151210 2024-09-17T04:35:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.160+0000 7fe1dc03f640 1 -- 172.21.15.43:0/1637066767 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d415bc60 con 0x7fe1d406ddc0 2024-09-17T04:35:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.160+0000 7fe1d95da640 1 --2- 172.21.15.43:0/1637066767 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1d40c3a80 0x7fe1d40c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.160+0000 7fe1da5dc640 1 --2- 172.21.15.43:0/1637066767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d4151210 0x7fe1d40ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.160+0000 7fe1d95da640 1 -- 172.21.15.43:0/1637066767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1d406ddc0 msgr2=0x7fe1d415c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.160+0000 7fe1d95da640 1 --2- 172.21.15.43:0/1637066767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1d406ddc0 0x7fe1d415c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.160+0000 7fe1d95da640 1 -- 172.21.15.43:0/1637066767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d4151210 msgr2=0x7fe1d40ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.160+0000 7fe1d95da640 1 --2- 172.21.15.43:0/1637066767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d4151210 0x7fe1d40ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.160+0000 7fe1d95da640 1 -- 172.21.15.43:0/1637066767 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d40c5be0 con 0x7fe1d40c3a80 2024-09-17T04:35:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.160+0000 7fe1d95da640 1 --2- 172.21.15.43:0/1637066767 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1d40c3a80 0x7fe1d40c56a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000b3e0 tx=0x7fe1d000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.161+0000 7fe1ca7fc640 1 -- 172.21.15.43:0/1637066767 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0015020 con 0x7fe1d40c3a80 2024-09-17T04:35:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.161+0000 7fe1ca7fc640 1 -- 172.21.15.43:0/1637066767 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1d0011920 con 0x7fe1d40c3a80 2024-09-17T04:35:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.161+0000 7fe1dc03f640 1 -- 172.21.15.43:0/1637066767 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d40c4600 con 0x7fe1d40c3a80 2024-09-17T04:35:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.161+0000 7fc246341640 1 -- 172.21.15.43:0/1249648108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc24006ddc0 msgr2=0x7fc2400c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.161+0000 7fc246341640 1 --2- 172.21.15.43:0/1249648108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc24006ddc0 0x7fc2400c9a80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc2400ca560 tx=0x7fc23003b5d0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.161+0000 7ff53234b640 1 Processor -- start 2024-09-17T04:35:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.161+0000 7fc246341640 1 -- 172.21.15.43:0/1249648108 shutdown_connections 2024-09-17T04:35:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.161+0000 7fc246341640 1 --2- 172.21.15.43:0/1249648108 >> v2:172.21.15.43:3300/0 conn(0x7fc24015ede0 0x7fc24015f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.161+0000 7fc246341640 1 --2- 172.21.15.43:0/1249648108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc24006ddc0 0x7fc2400c9a80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.161+0000 7fc246341640 1 --2- 172.21.15.43:0/1249648108 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2400c3a80 0x7fc24015c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.161+0000 7fc246341640 1 -- 172.21.15.43:0/1249648108 >> 172.21.15.43:0/1249648108 conn(0x7fc240070540 msgr2=0x7fc240070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.161+0000 7ff53234b640 1 -- start start 2024-09-17T04:35:00.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.161+0000 7fe1ca7fc640 1 -- 172.21.15.43:0/1637066767 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0011d50 con 0x7fe1d40c3a80 2024-09-17T04:35:00.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.161+0000 7fe1dc03f640 1 -- 172.21.15.43:0/1637066767 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d40c4bc0 con 0x7fe1d40c3a80 2024-09-17T04:35:00.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.161+0000 7fc246341640 1 -- 172.21.15.43:0/1249648108 shutdown_connections 2024-09-17T04:35:00.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.161+0000 7fc246341640 1 -- 172.21.15.43:0/1249648108 wait complete. 2024-09-17T04:35:00.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.163+0000 7fe1dc03f640 1 -- 172.21.15.43:0/1637066767 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe1d40c84f0 con 0x7fe1d40c3a80 2024-09-17T04:35:00.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.162+0000 7fe88ea55640 1 Processor -- start 2024-09-17T04:35:00.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.162+0000 7fe88ea55640 1 -- start start 2024-09-17T04:35:00.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.163+0000 7f161e4f2640 1 -- 172.21.15.43:0/3854267183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f160000a790 msgr2=0x7f160000cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.163+0000 7f161e4f2640 1 --2- 172.21.15.43:0/3854267183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f160000a790 0x7f160000cca0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1618074e70 tx=0x7f1600003810 comp rx=0 tx=0).stop 2024-09-17T04:35:00.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.163+0000 7ff53234b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff518003b90 0x7ff5240451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7ff53234b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5240d96a0 0x7ff5240d8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7ff53234b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5241740a0 0x7ff5241744b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7ff53234b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff524049940 con 0x7ff5241740a0 2024-09-17T04:35:00.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7ff53234b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff524049410 con 0x7ff518003b90 2024-09-17T04:35:00.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7ff53234b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff5240d5fd0 con 0x7ff5240d96a0 2024-09-17T04:35:00.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7f161e4f2640 1 -- 172.21.15.43:0/3854267183 shutdown_connections 2024-09-17T04:35:00.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7f161e4f2640 1 --2- 172.21.15.43:0/3854267183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f160000a790 0x7f160000cca0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7f161e4f2640 1 -- 172.21.15.43:0/3854267183 >> 172.21.15.43:0/3854267183 conn(0x7f16180c9660 msgr2=0x7f16180c9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7fe88ea55640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8880c8040 0x7fe8880cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7fe1ca7fc640 1 -- 172.21.15.43:0/1637066767 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe1d0018020 con 0x7fe1d40c3a80 2024-09-17T04:35:00.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7fe88ea55640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8880c9a90 0x7fe88815a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7f161e4f2640 1 -- 172.21.15.43:0/3854267183 shutdown_connections 2024-09-17T04:35:00.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7fe887fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8880c8040 0x7fe8880cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7fe887fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8880c8040 0x7fe8880cabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:59220/0 (socket says 172.21.15.43:59220) 2024-09-17T04:35:00.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7fc246341640 1 Processor -- start 2024-09-17T04:35:00.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7fe88ea55640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8880cce70 0x7fe8880cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7fe8877fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8880c9a90 0x7fe88815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7fe8877fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8880c9a90 0x7fe88815a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:59962/0 (socket says 172.21.15.43:59962) 2024-09-17T04:35:00.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7ff531b4a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5241740a0 0x7ff5241744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7ff531349640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff518003b90 0x7ff5240451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7ff531349640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff518003b90 0x7ff5240451d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:59218/0 (socket says 172.21.15.43:59218) 2024-09-17T04:35:00.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7ff531349640 1 -- 172.21.15.43:0/288106632 learned_addr learned my addr 172.21.15.43:0/288106632 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:00.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7ff530b48640 1 --2- 172.21.15.43:0/288106632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5240d96a0 0x7ff5240d8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7fc13d897640 1 -- 172.21.15.43:0/3945721690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1380c1d70 msgr2=0x7fc1380c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7fc13d897640 1 --2- 172.21.15.43:0/3945721690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1380c1d70 0x7fc1380c9cb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc128009ca0 tx=0x7fc12802aa70 comp rx=0 tx=0).stop 2024-09-17T04:35:00.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7fe88ea55640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe8880c28a0 con 0x7fe8880cce70 2024-09-17T04:35:00.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7fc246341640 1 -- start start 2024-09-17T04:35:00.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7ff531b4a640 1 -- 172.21.15.43:0/288106632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5240d96a0 msgr2=0x7ff5240d8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7ff531b4a640 1 --2- 172.21.15.43:0/288106632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5240d96a0 0x7ff5240d8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7ff531b4a640 1 -- 172.21.15.43:0/288106632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff518003b90 msgr2=0x7ff5240451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7ff531b4a640 1 --2- 172.21.15.43:0/288106632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff518003b90 0x7ff5240451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7ff531b4a640 1 -- 172.21.15.43:0/288106632 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5241749f0 con 0x7ff5241740a0 2024-09-17T04:35:00.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7fe88ea55640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe8880c2720 con 0x7fe8880c8040 2024-09-17T04:35:00.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7fe88ea55640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe8880c8450 con 0x7fe8880c9a90 2024-09-17T04:35:00.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7fe88cff2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8880cce70 0x7fe8880cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7fe88cff2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8880cce70 0x7fe8880cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41786/0 (socket says 172.21.15.43:41786) 2024-09-17T04:35:00.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7fe88cff2640 1 -- 172.21.15.43:0/4061686023 learned_addr learned my addr 172.21.15.43:0/4061686023 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:00.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7fc13d897640 1 -- 172.21.15.43:0/3945721690 shutdown_connections 2024-09-17T04:35:00.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7fc13d897640 1 --2- 172.21.15.43:0/3945721690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1380c1d70 0x7fc1380c9cb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7fc13d897640 1 -- 172.21.15.43:0/3945721690 >> 172.21.15.43:0/3945721690 conn(0x7fc138070090 msgr2=0x7fc1380704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7f66fffff640 1 Processor -- start 2024-09-17T04:35:00.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7f66fffff640 1 -- start start 2024-09-17T04:35:00.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7fc13d897640 1 -- 172.21.15.43:0/3945721690 shutdown_connections 2024-09-17T04:35:00.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.166+0000 7fe1ca7fc640 1 --2- 172.21.15.43:0/1637066767 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe1b8078b90 0x7fe1b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.166+0000 7fe1d9ddb640 1 --2- 172.21.15.43:0/1637066767 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe1b8078b90 0x7fe1b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.166+0000 7fe1ca7fc640 1 -- 172.21.15.43:0/1637066767 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe1d009ac70 con 0x7fe1d40c3a80 2024-09-17T04:35:00.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.167+0000 7fe1d9ddb640 1 --2- 172.21.15.43:0/1637066767 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe1b8078b90 0x7fe1b807b0a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009b80 tx=0x7fe1c4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.167+0000 7fe1ca7fc640 1 --2- 172.21.15.43:0/1637066767 >> [v2:172.21.15.43:6824/1564354446,v1:172.21.15.43:6825/1564354446] conn(0x7fe1b8080de0 0x7fe1b8083230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.167+0000 7fe1da5dc640 1 --2- 172.21.15.43:0/1637066767 >> [v2:172.21.15.43:6824/1564354446,v1:172.21.15.43:6825/1564354446] conn(0x7fe1b8080de0 0x7fe1b8083230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7fe1da5dc640 1 --2- 172.21.15.43:0/1637066767 >> [v2:172.21.15.43:6824/1564354446,v1:172.21.15.43:6825/1564354446] conn(0x7fe1b8080de0 0x7fe1b8083230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7fe1ca7fc640 1 -- 172.21.15.43:0/1637066767 --> [v2:172.21.15.43:6824/1564354446,v1:172.21.15.43:6825/1564354446] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1d000de50 con 0x7fe1b8080de0 2024-09-17T04:35:00.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.166+0000 7fe887fff640 1 -- 172.21.15.43:0/4061686023 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8880c9a90 msgr2=0x7fe88815a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.166+0000 7fe887fff640 1 --2- 172.21.15.43:0/4061686023 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8880c9a90 0x7fe88815a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.166+0000 7fe887fff640 1 -- 172.21.15.43:0/4061686023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8880cce70 msgr2=0x7fe8880cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.166+0000 7fe887fff640 1 --2- 172.21.15.43:0/4061686023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8880cce70 0x7fe8880cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.166+0000 7fe887fff640 1 -- 172.21.15.43:0/4061686023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8880cbe20 con 0x7fe8880c8040 2024-09-17T04:35:00.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.166+0000 7fe887fff640 1 --2- 172.21.15.43:0/4061686023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8880c8040 0x7fe8880cabd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe878031000 tx=0x7fe878003960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.164+0000 7f161e4f2640 1 -- 172.21.15.43:0/3854267183 wait complete. 2024-09-17T04:35:00.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7f161e4f2640 1 Processor -- start 2024-09-17T04:35:00.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.167+0000 7fc246341640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc24006ddc0 0x7fc2400cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7fc246341640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2400c3a80 0x7fc2400cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7fc23ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc24006ddc0 0x7fc2400cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7fc23f7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2400c3a80 0x7fc2400cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7fc23f7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2400c3a80 0x7fc2400cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:59990/0 (socket says 172.21.15.43:59990) 2024-09-17T04:35:00.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7fc23ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc24006ddc0 0x7fc2400cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:59226/0 (socket says 172.21.15.43:59226) 2024-09-17T04:35:00.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7fc23f7fe640 1 -- 172.21.15.43:0/85686016 learned_addr learned my addr 172.21.15.43:0/85686016 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:00.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7fc246341640 1 --2- 172.21.15.43:0/85686016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc24015ede0 0x7fc24014cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.166+0000 7ff531b4a640 1 --2- 172.21.15.43:0/288106632 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5241740a0 0x7ff5241744b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff52c06c490 tx=0x7ff52c075710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.167+0000 7ff521ffb640 1 -- 172.21.15.43:0/288106632 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c09d070 con 0x7ff5241740a0 2024-09-17T04:35:00.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.167+0000 7ff521ffb640 1 -- 172.21.15.43:0/288106632 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff52c06b040 con 0x7ff5241740a0 2024-09-17T04:35:00.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.167+0000 7ff521ffb640 1 -- 172.21.15.43:0/288106632 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c0973f0 con 0x7ff5241740a0 2024-09-17T04:35:00.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.167+0000 7ff53234b640 1 -- 172.21.15.43:0/288106632 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff524045710 con 0x7ff5241740a0 2024-09-17T04:35:00.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.167+0000 7ff53234b640 1 -- 172.21.15.43:0/288106632 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff524033ac0 con 0x7ff5241740a0 2024-09-17T04:35:00.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.165+0000 7fc13d897640 1 -- 172.21.15.43:0/3945721690 wait complete. 2024-09-17T04:35:00.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7fc246341640 1 -- 172.21.15.43:0/85686016 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc24015b980 con 0x7fc24015ede0 2024-09-17T04:35:00.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7fc246341640 1 -- 172.21.15.43:0/85686016 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc2400c9240 con 0x7fc24006ddc0 2024-09-17T04:35:00.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.167+0000 7f66fffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67000c7d10 0x7f67001f9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.167+0000 7f66fffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67000cccb0 0x7f6700155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.167+0000 7f66fffff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f670015ebd0 0x7f67000b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7f66fffff640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6700155cc0 con 0x7f67000c7d10 2024-09-17T04:35:00.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7f66fffff640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f670015efe0 con 0x7f67000cccb0 2024-09-17T04:35:00.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7f66fffff640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f67000cd0c0 con 0x7f670015ebd0 2024-09-17T04:35:00.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7f66feffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67000c7d10 0x7f67001f9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7f66feffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67000c7d10 0x7f67001f9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41800/0 (socket says 172.21.15.43:41800) 2024-09-17T04:35:00.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7f66feffd640 1 -- 172.21.15.43:0/1213021498 learned_addr learned my addr 172.21.15.43:0/1213021498 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:00.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7f66ff7fe640 1 --2- 172.21.15.43:0/1213021498 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f670015ebd0 0x7f67000b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7fc246341640 1 -- 172.21.15.43:0/85686016 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc24015bc60 con 0x7fc2400c3a80 2024-09-17T04:35:00.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7f66feffd640 1 -- 172.21.15.43:0/1213021498 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f670015ebd0 msgr2=0x7f67000b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7f66feffd640 1 --2- 172.21.15.43:0/1213021498 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f670015ebd0 0x7f67000b64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7f66feffd640 1 -- 172.21.15.43:0/1213021498 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67000cccb0 msgr2=0x7f6700155f00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T04:35:00.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7f66feffd640 1 --2- 172.21.15.43:0/1213021498 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67000cccb0 0x7f6700155f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7f66feffd640 1 -- 172.21.15.43:0/1213021498 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67001f5d00 con 0x7f67000c7d10 2024-09-17T04:35:00.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7fc13d897640 1 Processor -- start 2024-09-17T04:35:00.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7fe884ff9640 1 -- 172.21.15.43:0/4061686023 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87803f020 con 0x7fe8880c8040 2024-09-17T04:35:00.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.169+0000 7f66feffd640 1 --2- 172.21.15.43:0/1213021498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67000c7d10 0x7f67001f9d50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f66f000c460 tx=0x7f66f000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.169+0000 7ff53234b640 1 -- 172.21.15.43:0/288106632 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff524174d60 con 0x7ff5241740a0 2024-09-17T04:35:00.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.169+0000 7fc23f7fe640 1 -- 172.21.15.43:0/85686016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc24006ddc0 msgr2=0x7fc2400cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.169+0000 7fc23f7fe640 1 --2- 172.21.15.43:0/85686016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc24006ddc0 0x7fc2400cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.169+0000 7fc23f7fe640 1 -- 172.21.15.43:0/85686016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc24015ede0 msgr2=0x7fc24014cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.169+0000 7fc23f7fe640 1 --2- 172.21.15.43:0/85686016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc24015ede0 0x7fc24014cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.169+0000 7fc23f7fe640 1 -- 172.21.15.43:0/85686016 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2400cb0e0 con 0x7fc2400c3a80 2024-09-17T04:35:00.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.169+0000 7fe884ff9640 1 -- 172.21.15.43:0/4061686023 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe878004890 con 0x7fe8880c8040 2024-09-17T04:35:00.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.169+0000 7f161e4f2640 1 -- start start 2024-09-17T04:35:00.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.169+0000 7f66e7fff640 1 -- 172.21.15.43:0/1213021498 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0016020 con 0x7f67000c7d10 2024-09-17T04:35:00.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.169+0000 7fe88ea55640 1 -- 172.21.15.43:0/4061686023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8881534d0 con 0x7fe8880c8040 2024-09-17T04:35:00.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.169+0000 7f66fffff640 1 -- 172.21.15.43:0/1213021498 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67001501e0 con 0x7f67000c7d10 2024-09-17T04:35:00.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.169+0000 7f66fffff640 1 -- 172.21.15.43:0/1213021498 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f670015cb30 con 0x7f67000c7d10 2024-09-17T04:35:00.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.169+0000 7fe88ea55640 1 -- 172.21.15.43:0/4061686023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe888153a50 con 0x7fe8880c8040 2024-09-17T04:35:00.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.169+0000 7fe1ca7fc640 1 -- 172.21.15.43:0/1637066767 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe1d009d250 con 0x7fe1d40c3a80 2024-09-17T04:35:00.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.169+0000 7fe1ca7fc640 1 -- 172.21.15.43:0/1637066767 <== osd.1 v2:172.21.15.43:6824/1564354446 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe1d000de50 con 0x7fe1b8080de0 2024-09-17T04:35:00.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.170+0000 7f94da5f1640 1 -- 172.21.15.43:0/2790162621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c4003a50 msgr2=0x7f94c4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.168+0000 7fc13d897640 1 -- start start 2024-09-17T04:35:00.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.170+0000 7f66e7fff640 1 -- 172.21.15.43:0/1213021498 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66f0012a00 con 0x7f67000c7d10 2024-09-17T04:35:00.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.170+0000 7f94da5f1640 1 --2- 172.21.15.43:0/2790162621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c4003a50 0x7f94c4003ec0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f94c0009c10 tx=0x7f94c4005830 comp rx=0 tx=0).stop 2024-09-17T04:35:00.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.170+0000 7fc13d897640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1380c1d70 0x7fc13814ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.170+0000 7f94d8b8e640 1 -- 172.21.15.43:0/2790162621 reap_dead start 2024-09-17T04:35:00.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.170+0000 7f66e7fff640 1 -- 172.21.15.43:0/1213021498 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0012e50 con 0x7f67000c7d10 2024-09-17T04:35:00.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.170+0000 7f66fffff640 1 -- 172.21.15.43:0/1213021498 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6700155780 con 0x7f67000c7d10 2024-09-17T04:35:00.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7fc13d897640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13814e2f0 0x7fc1381514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7fc13d897640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1381578e0 0x7fc1380c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7fe884ff9640 1 -- 172.21.15.43:0/4061686023 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878035070 con 0x7fe8880c8040 2024-09-17T04:35:00.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7fc137fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13814e2f0 0x7fc1381514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7fc137fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13814e2f0 0x7fc1381514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41812/0 (socket says 172.21.15.43:41812) 2024-09-17T04:35:00.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7fc137fff640 1 -- 172.21.15.43:0/1711796043 learned_addr learned my addr 172.21.15.43:0/1711796043 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:00.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7fc13d897640 1 -- 172.21.15.43:0/1711796043 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc13814e700 con 0x7fc13814e2f0 2024-09-17T04:35:00.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7fc13d897640 1 -- 172.21.15.43:0/1711796043 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc1380c9820 con 0x7fc1380c1d70 2024-09-17T04:35:00.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7fc13d897640 1 -- 172.21.15.43:0/1711796043 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc138151ef0 con 0x7fc1381578e0 2024-09-17T04:35:00.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7fc13c895640 1 --2- 172.21.15.43:0/1711796043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1380c1d70 0x7fc13814ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7fe86e7fc640 1 -- 172.21.15.43:0/4061686023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe860001030 con 0x7fe8880c8040 2024-09-17T04:35:00.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7f94da5f1640 1 -- 172.21.15.43:0/2790162621 shutdown_connections 2024-09-17T04:35:00.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7fc13d096640 1 --2- 172.21.15.43:0/1711796043 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1381578e0 0x7fc1380c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7f94da5f1640 1 -- 172.21.15.43:0/2790162621 >> 172.21.15.43:0/2790162621 conn(0x7f94cc04fe30 msgr2=0x7f94cc050240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7fc137fff640 1 -- 172.21.15.43:0/1711796043 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1381578e0 msgr2=0x7fc1380c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7fc137fff640 1 --2- 172.21.15.43:0/1711796043 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1381578e0 0x7fc1380c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7fc137fff640 1 -- 172.21.15.43:0/1711796043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1380c1d70 msgr2=0x7fc13814ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7fc137fff640 1 --2- 172.21.15.43:0/1711796043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1380c1d70 0x7fc13814ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7fc137fff640 1 -- 172.21.15.43:0/1711796043 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc138156550 con 0x7fc13814e2f0 2024-09-17T04:35:00.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7f94da5f1640 1 -- 172.21.15.43:0/2790162621 shutdown_connections 2024-09-17T04:35:00.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7f94da5f1640 1 -- 172.21.15.43:0/2790162621 wait complete. 2024-09-17T04:35:00.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.172+0000 7fc137fff640 1 --2- 172.21.15.43:0/1711796043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13814e2f0 0x7fc1381514b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc128009bf0 tx=0x7fc128004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.172+0000 7fc1357fa640 1 -- 172.21.15.43:0/1711796043 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128045070 con 0x7fc13814e2f0 2024-09-17T04:35:00.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.172+0000 7fc1357fa640 1 -- 172.21.15.43:0/1711796043 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc128036400 con 0x7fc13814e2f0 2024-09-17T04:35:00.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.172+0000 7fc13d897640 1 -- 172.21.15.43:0/1711796043 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc138150ad0 con 0x7fc13814e2f0 2024-09-17T04:35:00.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7ff521ffb640 1 -- 172.21.15.43:0/288106632 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff52c0a0070 con 0x7ff5241740a0 2024-09-17T04:35:00.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.172+0000 7ff521ffb640 1 --2- 172.21.15.43:0/288106632 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7ff510078c60 0x7ff51007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.172+0000 7ff521ffb640 1 -- 172.21.15.43:0/288106632 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff52c117a80 con 0x7ff5241740a0 2024-09-17T04:35:00.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.172+0000 7ff521ffb640 1 --2- 172.21.15.43:0/288106632 >> [v2:172.21.15.62:6826/2558615114,v1:172.21.15.62:6827/2558615114] conn(0x7ff510080f30 0x7ff510083380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.172+0000 7ff521ffb640 1 -- 172.21.15.43:0/288106632 --> [v2:172.21.15.62:6826/2558615114,v1:172.21.15.62:6827/2558615114] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff52c091e50 con 0x7ff510080f30 2024-09-17T04:35:00.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.172+0000 7ff521ffb640 1 -- 172.21.15.43:0/288106632 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff52c119e60 con 0x7ff5241740a0 2024-09-17T04:35:00.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.172+0000 7fc13d897640 1 -- 172.21.15.43:0/1711796043 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1380c4000 con 0x7fc13814e2f0 2024-09-17T04:35:00.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7fc1357fa640 1 -- 172.21.15.43:0/1711796043 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128036830 con 0x7fc13814e2f0 2024-09-17T04:35:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7ff531349640 1 --2- 172.21.15.43:0/288106632 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7ff510078c60 0x7ff51007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.171+0000 7f161e4f2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f160000a790 0x7f16180c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.172+0000 7f161e4f2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f16180b2b10 0x7f16181f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.172+0000 7f161e4f2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16181510f0 0x7f161814ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.172+0000 7f161e4f2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f16180c2ae0 con 0x7f16181510f0 2024-09-17T04:35:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.172+0000 7f161e4f2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f16180c2800 con 0x7f160000a790 2024-09-17T04:35:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.172+0000 7f161e4f2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1618070df0 con 0x7f16180b2b10 2024-09-17T04:35:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7f161ca8f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16181510f0 0x7f161814ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7f16177fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f16180b2b10 0x7f16181f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7f161ca8f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16181510f0 0x7f161814ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41818/0 (socket says 172.21.15.43:41818) 2024-09-17T04:35:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7f16177fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f16180b2b10 0x7f16181f24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:60006/0 (socket says 172.21.15.43:60006) 2024-09-17T04:35:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7f161ca8f640 1 -- 172.21.15.43:0/745651085 learned_addr learned my addr 172.21.15.43:0/745651085 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7f66e7fff640 1 -- 172.21.15.43:0/1213021498 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66f0019020 con 0x7f67000c7d10 2024-09-17T04:35:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7f161ca8f640 1 -- 172.21.15.43:0/745651085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f16180b2b10 msgr2=0x7f16181f24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7f161ca8f640 1 --2- 172.21.15.43:0/745651085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f16180b2b10 0x7f16181f24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7f161ca8f640 1 -- 172.21.15.43:0/745651085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f160000a790 msgr2=0x7f16180c6b90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T04:35:00.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7f161ca8f640 1 --2- 172.21.15.43:0/745651085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f160000a790 0x7f16180c6b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7f161ca8f640 1 -- 172.21.15.43:0/745651085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16181f29e0 con 0x7f16181510f0 2024-09-17T04:35:00.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.174+0000 7ff530b48640 1 --2- 172.21.15.43:0/288106632 >> [v2:172.21.15.62:6826/2558615114,v1:172.21.15.62:6827/2558615114] conn(0x7ff510080f30 0x7ff510083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.174+0000 7f161ca8f640 1 --2- 172.21.15.43:0/745651085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16181510f0 0x7f161814ae90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f161000ae10 tx=0x7f16100305d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7fc23f7fe640 1 --2- 172.21.15.43:0/85686016 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2400c3a80 0x7fc2400cc4f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc230000c00 tx=0x7fc230004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7fc23cff9640 1 -- 172.21.15.43:0/85686016 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23004f020 con 0x7fc2400c3a80 2024-09-17T04:35:00.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7fc23cff9640 1 -- 172.21.15.43:0/85686016 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2300035f0 con 0x7fc2400c3a80 2024-09-17T04:35:00.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7fc23cff9640 1 -- 172.21.15.43:0/85686016 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc230046070 con 0x7fc2400c3a80 2024-09-17T04:35:00.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7fc246341640 1 -- 172.21.15.43:0/85686016 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2400cd7f0 con 0x7fc2400c3a80 2024-09-17T04:35:00.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.173+0000 7fc246341640 1 -- 172.21.15.43:0/85686016 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2400caea0 con 0x7fc2400c3a80 2024-09-17T04:35:00.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.175+0000 7f94da5f1640 1 Processor -- start 2024-09-17T04:35:00.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.175+0000 7f94da5f1640 1 -- start start 2024-09-17T04:35:00.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.174+0000 7f1614ff9640 1 -- 172.21.15.43:0/745651085 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610036070 con 0x7f16181510f0 2024-09-17T04:35:00.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.174+0000 7f161e4f2640 1 -- 172.21.15.43:0/745651085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16181f1cc0 con 0x7f16181510f0 2024-09-17T04:35:00.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.174+0000 7f1614ff9640 1 -- 172.21.15.43:0/745651085 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1610041070 con 0x7f16181510f0 2024-09-17T04:35:00.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.174+0000 7f1614ff9640 1 -- 172.21.15.43:0/745651085 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610030c20 con 0x7f16181510f0 2024-09-17T04:35:00.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.174+0000 7f161e4f2640 1 -- 172.21.15.43:0/745651085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16180c4170 con 0x7f16181510f0 2024-09-17T04:35:00.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.174+0000 7fc13d897640 1 -- 172.21.15.43:0/1711796043 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc13814f450 con 0x7fc13814e2f0 2024-09-17T04:35:00.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.174+0000 7fe884ff9640 1 -- 172.21.15.43:0/4061686023 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe878042020 con 0x7fe8880c8040 2024-09-17T04:35:00.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.175+0000 7fe884ff9640 1 --2- 172.21.15.43:0/4061686023 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe874078c60 0x7fe87407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.176+0000 7fe884ff9640 1 -- 172.21.15.43:0/4061686023 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe8780bbb80 con 0x7fe8880c8040 2024-09-17T04:35:00.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.176+0000 7fe884ff9640 1 --2- 172.21.15.43:0/4061686023 >> [v2:172.21.15.43:6800/1385342605,v1:172.21.15.43:6801/1385342605] conn(0x7fe874080f30 0x7fe874083380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.176+0000 7fe8877fe640 1 --2- 172.21.15.43:0/4061686023 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe874078c60 0x7fe87407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.176+0000 7fe88cff2640 1 --2- 172.21.15.43:0/4061686023 >> [v2:172.21.15.43:6800/1385342605,v1:172.21.15.43:6801/1385342605] conn(0x7fe874080f30 0x7fe874083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.177+0000 7fe8877fe640 1 --2- 172.21.15.43:0/4061686023 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe874078c60 0x7fe87407b170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe888071f80 tx=0x7fe87c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.177+0000 7fe88cff2640 1 --2- 172.21.15.43:0/4061686023 >> [v2:172.21.15.43:6800/1385342605,v1:172.21.15.43:6801/1385342605] conn(0x7fe874080f30 0x7fe874083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.177+0000 7fe884ff9640 1 -- 172.21.15.43:0/4061686023 --> [v2:172.21.15.43:6800/1385342605,v1:172.21.15.43:6801/1385342605] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe878009080 con 0x7fe874080f30 2024-09-17T04:35:00.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.177+0000 7fe884ff9640 1 -- 172.21.15.43:0/4061686023 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe8780bbef0 con 0x7fe8880c8040 2024-09-17T04:35:00.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.177+0000 7f1614ff9640 1 -- 172.21.15.43:0/745651085 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1610046460 con 0x7f16181510f0 2024-09-17T04:35:00.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.175+0000 7fc246341640 1 -- 172.21.15.43:0/85686016 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc240076b90 con 0x7fc2400c3a80 2024-09-17T04:35:00.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.176+0000 7f66e7fff640 1 --2- 172.21.15.43:0/1213021498 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f66ec078e00 0x7f66ec07b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.176+0000 7f66e7fff640 1 -- 172.21.15.43:0/1213021498 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f66f009ae80 con 0x7f67000c7d10 2024-09-17T04:35:00.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.176+0000 7f66fe7fc640 1 --2- 172.21.15.43:0/1213021498 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f66ec078e00 0x7f66ec07b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.177+0000 7f66e7fff640 1 --2- 172.21.15.43:0/1213021498 >> [v2:172.21.15.62:6810/1901653154,v1:172.21.15.62:6811/1901653154] conn(0x7f66ec0810d0 0x7f66ec083520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.177+0000 7f66e7fff640 1 -- 172.21.15.43:0/1213021498 --> [v2:172.21.15.62:6810/1901653154,v1:172.21.15.62:6811/1901653154] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66f0012e50 con 0x7f66ec0810d0 2024-09-17T04:35:00.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.177+0000 7f66e7fff640 1 -- 172.21.15.43:0/1213021498 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f66f009b270 con 0x7f67000c7d10 2024-09-17T04:35:00.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.177+0000 7f66ff7fe640 1 --2- 172.21.15.43:0/1213021498 >> [v2:172.21.15.62:6810/1901653154,v1:172.21.15.62:6811/1901653154] conn(0x7f66ec0810d0 0x7f66ec083520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.175+0000 7fc1357fa640 1 -- 172.21.15.43:0/1711796043 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc1280369d0 con 0x7fc13814e2f0 2024-09-17T04:35:00.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.176+0000 7fc1357fa640 1 --2- 172.21.15.43:0/1711796043 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc118078bc0 0x7fc11807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.177+0000 7fc1357fa640 1 -- 172.21.15.43:0/1711796043 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc1280ba770 con 0x7fc13814e2f0 2024-09-17T04:35:00.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.177+0000 7fc1357fa640 1 --2- 172.21.15.43:0/1711796043 >> [v2:172.21.15.62:6818/2974376041,v1:172.21.15.62:6819/2974376041] conn(0x7fc1180819c0 0x7fc118083eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.177+0000 7fc1357fa640 1 -- 172.21.15.43:0/1711796043 --> [v2:172.21.15.62:6818/2974376041,v1:172.21.15.62:6819/2974376041] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc118084580 con 0x7fc1180819c0 2024-09-17T04:35:00.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.177+0000 7fc13c895640 1 --2- 172.21.15.43:0/1711796043 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc118078bc0 0x7fc11807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.177+0000 7fc13d096640 1 --2- 172.21.15.43:0/1711796043 >> [v2:172.21.15.62:6818/2974376041,v1:172.21.15.62:6819/2974376041] conn(0x7fc1180819c0 0x7fc118083eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.177+0000 7fc1357fa640 1 -- 172.21.15.43:0/1711796043 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc1280807a0 con 0x7fc13814e2f0 2024-09-17T04:35:00.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7f161e4f2640 1 -- 172.21.15.43:0/745651085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f15f8001030 con 0x7f16181510f0 2024-09-17T04:35:00.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7fc23cff9640 1 -- 172.21.15.43:0/85686016 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc230052020 con 0x7fc2400c3a80 2024-09-17T04:35:00.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7ff531349640 1 --2- 172.21.15.43:0/288106632 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7ff510078c60 0x7ff51007b170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff528006f10 tx=0x7ff528006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7f94da5f1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94c4003a50 0x7f94cc0dbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.177+0000 7f66fe7fc640 1 --2- 172.21.15.43:0/1213021498 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f66ec078e00 0x7f66ec07b310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f670014a5d0 tx=0x7f66f8009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7ff530b48640 1 --2- 172.21.15.43:0/288106632 >> [v2:172.21.15.62:6826/2558615114,v1:172.21.15.62:6827/2558615114] conn(0x7ff510080f30 0x7ff510083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7f94da5f1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94cc0d6780 0x7f94cc0d9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7fe884ff9640 1 -- 172.21.15.43:0/4061686023 <== osd.2 v2:172.21.15.43:6800/1385342605 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe878009080 con 0x7fe874080f30 2024-09-17T04:35:00.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7fc13c895640 1 --2- 172.21.15.43:0/1711796043 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc118078bc0 0x7fc11807b0d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc120006fd0 tx=0x7fc120009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7f66ff7fe640 1 --2- 172.21.15.43:0/1213021498 >> [v2:172.21.15.62:6810/1901653154,v1:172.21.15.62:6811/1901653154] conn(0x7f66ec0810d0 0x7f66ec083520 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7f94d37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94cc0d6780 0x7f94cc0d9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7f1614ff9640 1 --2- 172.21.15.43:0/745651085 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1604078c60 0x7f160407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7fc13d096640 1 --2- 172.21.15.43:0/1711796043 >> [v2:172.21.15.62:6818/2974376041,v1:172.21.15.62:6819/2974376041] conn(0x7fc1180819c0 0x7fc118083eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7f94d37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94cc0d6780 0x7f94cc0d9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35248/0 (socket says 172.21.15.43:35248) 2024-09-17T04:35:00.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7fc23cff9640 1 --2- 172.21.15.43:0/85686016 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc22c078c90 0x7fc22c07b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7f94d3fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94c4003a50 0x7f94cc0dbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7f94d3fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94c4003a50 0x7f94cc0dbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:51918/0 (socket says 172.21.15.43:51918) 2024-09-17T04:35:00.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7f94d37fe640 1 -- 172.21.15.43:0/2041027343 learned_addr learned my addr 172.21.15.43:0/2041027343 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:00.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.178+0000 7f1617fff640 1 --2- 172.21.15.43:0/745651085 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1604078c60 0x7f160407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7f1614ff9640 1 -- 172.21.15.43:0/745651085 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f16100bba80 con 0x7f16181510f0 2024-09-17T04:35:00.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7f94da5f1640 1 --2- 172.21.15.43:0/2041027343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94cc0cc700 0x7f94cc0ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7fc23cff9640 1 -- 172.21.15.43:0/85686016 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc2300ccb30 con 0x7fc2400c3a80 2024-09-17T04:35:00.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7fc23ffff640 1 --2- 172.21.15.43:0/85686016 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc22c078c90 0x7fc22c07b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7f94da5f1640 1 -- 172.21.15.43:0/2041027343 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc045630 con 0x7f94cc0d6780 2024-09-17T04:35:00.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7f1614ff9640 1 --2- 172.21.15.43:0/745651085 >> [v2:172.21.15.43:6808/1646004903,v1:172.21.15.43:6809/1646004903] conn(0x7f1604080f30 0x7f1604083380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7f94da5f1640 1 -- 172.21.15.43:0/2041027343 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc0454b0 con 0x7f94c4003a50 2024-09-17T04:35:00.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7f1614ff9640 1 -- 172.21.15.43:0/745651085 --> [v2:172.21.15.43:6808/1646004903,v1:172.21.15.43:6809/1646004903] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1610037e50 con 0x7f1604080f30 2024-09-17T04:35:00.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7f94da5f1640 1 -- 172.21.15.43:0/2041027343 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f94cc0457b0 con 0x7f94cc0cc700 2024-09-17T04:35:00.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7f1614ff9640 1 -- 172.21.15.43:0/745651085 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f16100c2050 con 0x7f16181510f0 2024-09-17T04:35:00.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7fc23cff9640 1 --2- 172.21.15.43:0/85686016 >> [v2:172.21.15.62:6802/3991694106,v1:172.21.15.62:6803/3991694106] conn(0x7fc22c080f60 0x7fc22c0833b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7f94d8b8e640 1 --2- 172.21.15.43:0/2041027343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94cc0cc700 0x7f94cc0ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7fc23cff9640 1 -- 172.21.15.43:0/85686016 --> [v2:172.21.15.62:6802/3991694106,v1:172.21.15.62:6803/3991694106] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc230005110 con 0x7fc22c080f60 2024-09-17T04:35:00.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7fc23cff9640 1 -- 172.21.15.43:0/85686016 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc2300ccea0 con 0x7fc2400c3a80 2024-09-17T04:35:00.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7f16177fe640 1 --2- 172.21.15.43:0/745651085 >> [v2:172.21.15.43:6808/1646004903,v1:172.21.15.43:6809/1646004903] conn(0x7f1604080f30 0x7f1604083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7ff521ffb640 1 -- 172.21.15.43:0/288106632 <== osd.5 v2:172.21.15.62:6826/2558615114 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff52c091e50 con 0x7ff510080f30 2024-09-17T04:35:00.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7fc2448de640 1 --2- 172.21.15.43:0/85686016 >> [v2:172.21.15.62:6802/3991694106,v1:172.21.15.62:6803/3991694106] conn(0x7fc22c080f60 0x7fc22c0833b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7f1617fff640 1 --2- 172.21.15.43:0/745651085 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1604078c60 0x7f160407b170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16080046b0 tx=0x7f1608007a70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7f66e7fff640 1 -- 172.21.15.43:0/1213021498 <== osd.6 v2:172.21.15.62:6810/1901653154 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f66f0012e50 con 0x7f66ec0810d0 2024-09-17T04:35:00.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.179+0000 7fc23ffff640 1 --2- 172.21.15.43:0/85686016 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc22c078c90 0x7fc22c07b1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc234006fd0 tx=0x7fc234009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.180+0000 7fc1357fa640 1 -- 172.21.15.43:0/1711796043 <== osd.7 v2:172.21.15.62:6818/2974376041 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc118084580 con 0x7fc1180819c0 2024-09-17T04:35:00.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.180+0000 7fc2448de640 1 --2- 172.21.15.43:0/85686016 >> [v2:172.21.15.62:6802/3991694106,v1:172.21.15.62:6803/3991694106] conn(0x7fc22c080f60 0x7fc22c0833b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.180+0000 7f16177fe640 1 --2- 172.21.15.43:0/745651085 >> [v2:172.21.15.43:6808/1646004903,v1:172.21.15.43:6809/1646004903] conn(0x7f1604080f30 0x7f1604083380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.181+0000 7fc23cff9640 1 -- 172.21.15.43:0/85686016 <== osd.4 v2:172.21.15.62:6802/3991694106 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc230005110 con 0x7fc22c080f60 2024-09-17T04:35:00.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.182+0000 7f1614ff9640 1 -- 172.21.15.43:0/745651085 <== osd.3 v2:172.21.15.43:6808/1646004903 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1610037e50 con 0x7f1604080f30 2024-09-17T04:35:00.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.180+0000 7f94d3fff640 1 -- 172.21.15.43:0/2041027343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94cc0cc700 msgr2=0x7f94cc0ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.180+0000 7f94d3fff640 1 --2- 172.21.15.43:0/2041027343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94cc0cc700 0x7f94cc0ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.180+0000 7f94d3fff640 1 -- 172.21.15.43:0/2041027343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94cc0d6780 msgr2=0x7f94cc0d9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.180+0000 7f94d3fff640 1 --2- 172.21.15.43:0/2041027343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94cc0d6780 0x7f94cc0d9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.180+0000 7f94d3fff640 1 -- 172.21.15.43:0/2041027343 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94cc0cd050 con 0x7f94c4003a50 2024-09-17T04:35:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.180+0000 7f94d3fff640 1 --2- 172.21.15.43:0/2041027343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94c4003a50 0x7f94cc0dbf80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f94c0032000 tx=0x7f94c0003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.180+0000 7f94d0ff9640 1 -- 172.21.15.43:0/2041027343 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c0038050 con 0x7f94c4003a50 2024-09-17T04:35:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.180+0000 7f94d0ff9640 1 -- 172.21.15.43:0/2041027343 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94c0039040 con 0x7f94c4003a50 2024-09-17T04:35:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.180+0000 7f94da5f1640 1 -- 172.21.15.43:0/2041027343 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94cc0db770 con 0x7f94c4003a50 2024-09-17T04:35:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.180+0000 7f94d0ff9640 1 -- 172.21.15.43:0/2041027343 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c0009810 con 0x7f94c4003a50 2024-09-17T04:35:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.180+0000 7f94da5f1640 1 -- 172.21.15.43:0/2041027343 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94cc04eb30 con 0x7f94c4003a50 2024-09-17T04:35:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.182+0000 7f94d37fe640 1 --2- 172.21.15.43:0/2041027343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94cc0d6780 0x7f94cc0d9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:35:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.182+0000 7f94da5f1640 1 -- 172.21.15.43:0/2041027343 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f94cc04b780 con 0x7f94c4003a50 2024-09-17T04:35:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.183+0000 7f94d0ff9640 1 -- 172.21.15.43:0/2041027343 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f94c003f450 con 0x7f94c4003a50 2024-09-17T04:35:00.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.184+0000 7f94d0ff9640 1 --2- 172.21.15.43:0/2041027343 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f94b8078c90 0x7f94b807b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.184+0000 7f94d0ff9640 1 -- 172.21.15.43:0/2041027343 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f94c00bbbc0 con 0x7f94c4003a50 2024-09-17T04:35:00.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.185+0000 7f94d0ff9640 1 --2- 172.21.15.43:0/2041027343 >> [v2:172.21.15.43:6816/1685480205,v1:172.21.15.43:6817/1685480205] conn(0x7f94b8080f60 0x7f94b80833b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.185+0000 7f94d0ff9640 1 -- 172.21.15.43:0/2041027343 --> [v2:172.21.15.43:6816/1685480205,v1:172.21.15.43:6817/1685480205] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f94b8083a80 con 0x7f94b8080f60 2024-09-17T04:35:00.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.185+0000 7f94d0ff9640 1 -- 172.21.15.43:0/2041027343 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f94c00c2050 con 0x7f94c4003a50 2024-09-17T04:35:00.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.185+0000 7f94d8b8e640 1 --2- 172.21.15.43:0/2041027343 >> [v2:172.21.15.43:6816/1685480205,v1:172.21.15.43:6817/1685480205] conn(0x7f94b8080f60 0x7f94b80833b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.185+0000 7f94d37fe640 1 --2- 172.21.15.43:0/2041027343 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f94b8078c90 0x7f94b807b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.186+0000 7f94d8b8e640 1 --2- 172.21.15.43:0/2041027343 >> [v2:172.21.15.43:6816/1685480205,v1:172.21.15.43:6817/1685480205] conn(0x7f94b8080f60 0x7f94b80833b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.187+0000 7f94d0ff9640 1 -- 172.21.15.43:0/2041027343 <== osd.0 v2:172.21.15.43:6816/1685480205 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f94b8083a80 con 0x7f94b8080f60 2024-09-17T04:35:00.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.191+0000 7f94d37fe640 1 --2- 172.21.15.43:0/2041027343 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f94b8078c90 0x7f94b807b1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94c8006630 tx=0x7f94c8006660 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.203+0000 7fe1dc03f640 1 -- 172.21.15.43:0/1637066767 --> [v2:172.21.15.43:6824/1564354446,v1:172.21.15.43:6825/1564354446] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe1d40c80b0 con 0x7fe1b8080de0 2024-09-17T04:35:00.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.204+0000 7fe1ca7fc640 1 -- 172.21.15.43:0/1637066767 <== osd.1 v2:172.21.15.43:6824/1564354446 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe1d40c80b0 con 0x7fe1b8080de0 2024-09-17T04:35:00.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.204+0000 7fe1b7fff640 1 -- 172.21.15.43:0/1637066767 >> [v2:172.21.15.43:6824/1564354446,v1:172.21.15.43:6825/1564354446] conn(0x7fe1b8080de0 msgr2=0x7fe1b8083230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.204+0000 7fe1b7fff640 1 --2- 172.21.15.43:0/1637066767 >> [v2:172.21.15.43:6824/1564354446,v1:172.21.15.43:6825/1564354446] conn(0x7fe1b8080de0 0x7fe1b8083230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.205+0000 7fe1b7fff640 1 -- 172.21.15.43:0/1637066767 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe1b8078b90 msgr2=0x7fe1b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.205+0000 7fe1b7fff640 1 --2- 172.21.15.43:0/1637066767 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe1b8078b90 0x7fe1b807b0a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009b80 tx=0x7fe1c4005f90 comp rx=0 tx=0).stop 2024-09-17T04:35:00.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.205+0000 7fe1b7fff640 1 -- 172.21.15.43:0/1637066767 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1d40c3a80 msgr2=0x7fe1d40c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.205+0000 7fe1b7fff640 1 --2- 172.21.15.43:0/1637066767 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1d40c3a80 0x7fe1d40c56a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000b3e0 tx=0x7fe1d000b8a0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.205+0000 7fe1da5dc640 1 -- 172.21.15.43:0/1637066767 reap_dead start 2024-09-17T04:35:00.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.205+0000 7fe1b7fff640 1 -- 172.21.15.43:0/1637066767 shutdown_connections 2024-09-17T04:35:00.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.205+0000 7fe1b7fff640 1 -- 172.21.15.43:0/1637066767 >> 172.21.15.43:0/1637066767 conn(0x7fe1d4070540 msgr2=0x7fe1d414fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.205+0000 7fe1b7fff640 1 -- 172.21.15.43:0/1637066767 shutdown_connections 2024-09-17T04:35:00.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.206+0000 7fe1b7fff640 1 -- 172.21.15.43:0/1637066767 wait complete. 2024-09-17T04:35:00.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.209+0000 7fe86e7fc640 1 -- 172.21.15.43:0/4061686023 --> [v2:172.21.15.43:6800/1385342605,v1:172.21.15.43:6801/1385342605] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe860002dd0 con 0x7fe874080f30 2024-09-17T04:35:00.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.209+0000 7fe884ff9640 1 -- 172.21.15.43:0/4061686023 <== osd.2 v2:172.21.15.43:6800/1385342605 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe860002dd0 con 0x7fe874080f30 2024-09-17T04:35:00.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.210+0000 7fe88ea55640 1 -- 172.21.15.43:0/4061686023 >> [v2:172.21.15.43:6800/1385342605,v1:172.21.15.43:6801/1385342605] conn(0x7fe874080f30 msgr2=0x7fe874083380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.210+0000 7fe88ea55640 1 --2- 172.21.15.43:0/4061686023 >> [v2:172.21.15.43:6800/1385342605,v1:172.21.15.43:6801/1385342605] conn(0x7fe874080f30 0x7fe874083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.210+0000 7fe88ea55640 1 -- 172.21.15.43:0/4061686023 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe874078c60 msgr2=0x7fe87407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.210+0000 7fe88ea55640 1 --2- 172.21.15.43:0/4061686023 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe874078c60 0x7fe87407b170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe888071f80 tx=0x7fe87c00b2e0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.210+0000 7fe88ea55640 1 -- 172.21.15.43:0/4061686023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8880c8040 msgr2=0x7fe8880cabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.211+0000 7fe88ea55640 1 --2- 172.21.15.43:0/4061686023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8880c8040 0x7fe8880cabd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe878031000 tx=0x7fe878003960 comp rx=0 tx=0).stop 2024-09-17T04:35:00.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.211+0000 7fe88cff2640 1 -- 172.21.15.43:0/4061686023 reap_dead start 2024-09-17T04:35:00.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.211+0000 7ff53234b640 1 -- 172.21.15.43:0/288106632 --> [v2:172.21.15.62:6826/2558615114,v1:172.21.15.62:6827/2558615114] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff52404d760 con 0x7ff510080f30 2024-09-17T04:35:00.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.211+0000 7fe88ea55640 1 -- 172.21.15.43:0/4061686023 shutdown_connections 2024-09-17T04:35:00.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.211+0000 7fe88ea55640 1 -- 172.21.15.43:0/4061686023 >> 172.21.15.43:0/4061686023 conn(0x7fe888070540 msgr2=0x7fe888076290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.211+0000 7fe88ea55640 1 -- 172.21.15.43:0/4061686023 shutdown_connections 2024-09-17T04:35:00.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.211+0000 7fe88ea55640 1 -- 172.21.15.43:0/4061686023 wait complete. 2024-09-17T04:35:00.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.211+0000 7ff521ffb640 1 -- 172.21.15.43:0/288106632 <== osd.5 v2:172.21.15.62:6826/2558615114 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff52404d760 con 0x7ff510080f30 2024-09-17T04:35:00.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.212+0000 7ff53234b640 1 -- 172.21.15.43:0/288106632 >> [v2:172.21.15.62:6826/2558615114,v1:172.21.15.62:6827/2558615114] conn(0x7ff510080f30 msgr2=0x7ff510083380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.212+0000 7ff53234b640 1 --2- 172.21.15.43:0/288106632 >> [v2:172.21.15.62:6826/2558615114,v1:172.21.15.62:6827/2558615114] conn(0x7ff510080f30 0x7ff510083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.212+0000 7fc13d897640 1 -- 172.21.15.43:0/1711796043 --> [v2:172.21.15.62:6818/2974376041,v1:172.21.15.62:6819/2974376041] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc13814ed00 con 0x7fc1180819c0 2024-09-17T04:35:00.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.212+0000 7ff53234b640 1 -- 172.21.15.43:0/288106632 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7ff510078c60 msgr2=0x7ff51007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.212+0000 7ff53234b640 1 --2- 172.21.15.43:0/288106632 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7ff510078c60 0x7ff51007b170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff528006f10 tx=0x7ff528006000 comp rx=0 tx=0).stop 2024-09-17T04:35:00.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.212+0000 7ff53234b640 1 -- 172.21.15.43:0/288106632 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5241740a0 msgr2=0x7ff5241744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.212+0000 7ff53234b640 1 --2- 172.21.15.43:0/288106632 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5241740a0 0x7ff5241744b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff52c06c490 tx=0x7ff52c075710 comp rx=0 tx=0).stop 2024-09-17T04:35:00.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.212+0000 7ff531b4a640 1 -- 172.21.15.43:0/288106632 reap_dead start 2024-09-17T04:35:00.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.213+0000 7ff53234b640 1 -- 172.21.15.43:0/288106632 shutdown_connections 2024-09-17T04:35:00.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.213+0000 7ff53234b640 1 -- 172.21.15.43:0/288106632 >> 172.21.15.43:0/288106632 conn(0x7ff524050fa0 msgr2=0x7ff5240d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.213+0000 7ff53234b640 1 -- 172.21.15.43:0/288106632 shutdown_connections 2024-09-17T04:35:00.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.213+0000 7fc1357fa640 1 -- 172.21.15.43:0/1711796043 <== osd.7 v2:172.21.15.62:6818/2974376041 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc13814ed00 con 0x7fc1180819c0 2024-09-17T04:35:00.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.213+0000 7ff53234b640 1 -- 172.21.15.43:0/288106632 wait complete. 2024-09-17T04:35:00.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.213+0000 7f66fffff640 1 -- 172.21.15.43:0/1213021498 --> [v2:172.21.15.62:6810/1901653154,v1:172.21.15.62:6811/1901653154] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6700159050 con 0x7f66ec0810d0 2024-09-17T04:35:00.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.213+0000 7fc246341640 1 -- 172.21.15.43:0/85686016 --> [v2:172.21.15.62:6802/3991694106,v1:172.21.15.62:6803/3991694106] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc24015e3d0 con 0x7fc22c080f60 2024-09-17T04:35:00.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.213+0000 7f161e4f2640 1 -- 172.21.15.43:0/745651085 --> [v2:172.21.15.43:6808/1646004903,v1:172.21.15.43:6809/1646004903] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f15f8002dd0 con 0x7f1604080f30 2024-09-17T04:35:00.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.213+0000 7fc13d897640 1 -- 172.21.15.43:0/1711796043 >> [v2:172.21.15.62:6818/2974376041,v1:172.21.15.62:6819/2974376041] conn(0x7fc1180819c0 msgr2=0x7fc118083eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.213+0000 7fc13d897640 1 --2- 172.21.15.43:0/1711796043 >> [v2:172.21.15.62:6818/2974376041,v1:172.21.15.62:6819/2974376041] conn(0x7fc1180819c0 0x7fc118083eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7fc23cff9640 1 -- 172.21.15.43:0/85686016 <== osd.4 v2:172.21.15.62:6802/3991694106 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc24015e3d0 con 0x7fc22c080f60 2024-09-17T04:35:00.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7fc13d897640 1 -- 172.21.15.43:0/1711796043 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc118078bc0 msgr2=0x7fc11807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7fc13d897640 1 --2- 172.21.15.43:0/1711796043 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc118078bc0 0x7fc11807b0d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc120006fd0 tx=0x7fc120009060 comp rx=0 tx=0).stop 2024-09-17T04:35:00.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7fc13d897640 1 -- 172.21.15.43:0/1711796043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13814e2f0 msgr2=0x7fc1381514b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7fc13d897640 1 --2- 172.21.15.43:0/1711796043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13814e2f0 0x7fc1381514b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc128009bf0 tx=0x7fc128004270 comp rx=0 tx=0).stop 2024-09-17T04:35:00.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7fc13d096640 1 -- 172.21.15.43:0/1711796043 reap_dead start 2024-09-17T04:35:00.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7f1614ff9640 1 -- 172.21.15.43:0/745651085 <== osd.3 v2:172.21.15.43:6808/1646004903 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f15f8002dd0 con 0x7f1604080f30 2024-09-17T04:35:00.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7fc13d897640 1 -- 172.21.15.43:0/1711796043 shutdown_connections 2024-09-17T04:35:00.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7fc13d897640 1 -- 172.21.15.43:0/1711796043 >> 172.21.15.43:0/1711796043 conn(0x7fc138070090 msgr2=0x7fc138143a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7f66e7fff640 1 -- 172.21.15.43:0/1213021498 <== osd.6 v2:172.21.15.62:6810/1901653154 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6700159050 con 0x7f66ec0810d0 2024-09-17T04:35:00.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7fc13d897640 1 -- 172.21.15.43:0/1711796043 shutdown_connections 2024-09-17T04:35:00.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7fc13d897640 1 -- 172.21.15.43:0/1711796043 wait complete. 2024-09-17T04:35:00.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7fc246341640 1 -- 172.21.15.43:0/85686016 >> [v2:172.21.15.62:6802/3991694106,v1:172.21.15.62:6803/3991694106] conn(0x7fc22c080f60 msgr2=0x7fc22c0833b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7fc246341640 1 --2- 172.21.15.43:0/85686016 >> [v2:172.21.15.62:6802/3991694106,v1:172.21.15.62:6803/3991694106] conn(0x7fc22c080f60 0x7fc22c0833b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7fc246341640 1 -- 172.21.15.43:0/85686016 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc22c078c90 msgr2=0x7fc22c07b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7fc246341640 1 --2- 172.21.15.43:0/85686016 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc22c078c90 0x7fc22c07b1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc234006fd0 tx=0x7fc234009060 comp rx=0 tx=0).stop 2024-09-17T04:35:00.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7fc246341640 1 -- 172.21.15.43:0/85686016 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2400c3a80 msgr2=0x7fc2400cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.214+0000 7fc246341640 1 --2- 172.21.15.43:0/85686016 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2400c3a80 0x7fc2400cc4f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc230000c00 tx=0x7fc230004a50 comp rx=0 tx=0).stop 2024-09-17T04:35:00.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.215+0000 7fc2448de640 1 -- 172.21.15.43:0/85686016 reap_dead start 2024-09-17T04:35:00.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.215+0000 7fc246341640 1 -- 172.21.15.43:0/85686016 shutdown_connections 2024-09-17T04:35:00.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.215+0000 7fc246341640 1 -- 172.21.15.43:0/85686016 >> 172.21.15.43:0/85686016 conn(0x7fc240070540 msgr2=0x7fc24014eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.215+0000 7f161e4f2640 1 -- 172.21.15.43:0/745651085 >> [v2:172.21.15.43:6808/1646004903,v1:172.21.15.43:6809/1646004903] conn(0x7f1604080f30 msgr2=0x7f1604083380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.215+0000 7f161e4f2640 1 --2- 172.21.15.43:0/745651085 >> [v2:172.21.15.43:6808/1646004903,v1:172.21.15.43:6809/1646004903] conn(0x7f1604080f30 0x7f1604083380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.215+0000 7fc246341640 1 -- 172.21.15.43:0/85686016 shutdown_connections 2024-09-17T04:35:00.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.216+0000 7fc246341640 1 -- 172.21.15.43:0/85686016 wait complete. 2024-09-17T04:35:00.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.216+0000 7f161e4f2640 1 -- 172.21.15.43:0/745651085 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1604078c60 msgr2=0x7f160407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.216+0000 7f161e4f2640 1 --2- 172.21.15.43:0/745651085 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1604078c60 0x7f160407b170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16080046b0 tx=0x7f1608007a70 comp rx=0 tx=0).stop 2024-09-17T04:35:00.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.216+0000 7f161e4f2640 1 -- 172.21.15.43:0/745651085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16181510f0 msgr2=0x7f161814ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.216+0000 7f161e4f2640 1 --2- 172.21.15.43:0/745651085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16181510f0 0x7f161814ae90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f161000ae10 tx=0x7f16100305d0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.216+0000 7f161ca8f640 1 -- 172.21.15.43:0/745651085 reap_dead start 2024-09-17T04:35:00.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.216+0000 7f161e4f2640 1 -- 172.21.15.43:0/745651085 shutdown_connections 2024-09-17T04:35:00.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.216+0000 7f161e4f2640 1 -- 172.21.15.43:0/745651085 >> 172.21.15.43:0/745651085 conn(0x7f16180c9660 msgr2=0x7f1618070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.216+0000 7f161e4f2640 1 -- 172.21.15.43:0/745651085 shutdown_connections 2024-09-17T04:35:00.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.216+0000 7f161e4f2640 1 -- 172.21.15.43:0/745651085 wait complete. 2024-09-17T04:35:00.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.216+0000 7f66fffff640 1 -- 172.21.15.43:0/1213021498 >> [v2:172.21.15.62:6810/1901653154,v1:172.21.15.62:6811/1901653154] conn(0x7f66ec0810d0 msgr2=0x7f66ec083520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.217+0000 7f66fffff640 1 --2- 172.21.15.43:0/1213021498 >> [v2:172.21.15.62:6810/1901653154,v1:172.21.15.62:6811/1901653154] conn(0x7f66ec0810d0 0x7f66ec083520 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.217+0000 7f66fffff640 1 -- 172.21.15.43:0/1213021498 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f66ec078e00 msgr2=0x7f66ec07b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.217+0000 7f66fffff640 1 --2- 172.21.15.43:0/1213021498 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f66ec078e00 0x7f66ec07b310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f670014a5d0 tx=0x7f66f8009500 comp rx=0 tx=0).stop 2024-09-17T04:35:00.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.217+0000 7f66fffff640 1 -- 172.21.15.43:0/1213021498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67000c7d10 msgr2=0x7f67001f9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.217+0000 7f66fffff640 1 --2- 172.21.15.43:0/1213021498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67000c7d10 0x7f67001f9d50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f66f000c460 tx=0x7f66f000c920 comp rx=0 tx=0).stop 2024-09-17T04:35:00.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.217+0000 7f66ff7fe640 1 -- 172.21.15.43:0/1213021498 reap_dead start 2024-09-17T04:35:00.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.217+0000 7f66fffff640 1 -- 172.21.15.43:0/1213021498 shutdown_connections 2024-09-17T04:35:00.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.217+0000 7f66fffff640 1 -- 172.21.15.43:0/1213021498 >> 172.21.15.43:0/1213021498 conn(0x7f670006f0e0 msgr2=0x7f670006f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.217+0000 7f94da5f1640 1 -- 172.21.15.43:0/2041027343 --> [v2:172.21.15.43:6816/1685480205,v1:172.21.15.43:6817/1685480205] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f94cc04bf40 con 0x7f94b8080f60 2024-09-17T04:35:00.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.217+0000 7f66fffff640 1 -- 172.21.15.43:0/1213021498 shutdown_connections 2024-09-17T04:35:00.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.217+0000 7f66fffff640 1 -- 172.21.15.43:0/1213021498 wait complete. 2024-09-17T04:35:00.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.218+0000 7f94d0ff9640 1 -- 172.21.15.43:0/2041027343 <== osd.0 v2:172.21.15.43:6816/1685480205 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f94cc04bf40 con 0x7f94b8080f60 2024-09-17T04:35:00.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.219+0000 7f94be7fc640 1 -- 172.21.15.43:0/2041027343 >> [v2:172.21.15.43:6816/1685480205,v1:172.21.15.43:6817/1685480205] conn(0x7f94b8080f60 msgr2=0x7f94b80833b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.219+0000 7f94be7fc640 1 --2- 172.21.15.43:0/2041027343 >> [v2:172.21.15.43:6816/1685480205,v1:172.21.15.43:6817/1685480205] conn(0x7f94b8080f60 0x7f94b80833b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.219+0000 7f94be7fc640 1 -- 172.21.15.43:0/2041027343 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f94b8078c90 msgr2=0x7f94b807b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.219+0000 7f94be7fc640 1 --2- 172.21.15.43:0/2041027343 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f94b8078c90 0x7f94b807b1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94c8006630 tx=0x7f94c8006660 comp rx=0 tx=0).stop 2024-09-17T04:35:00.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.219+0000 7f94be7fc640 1 -- 172.21.15.43:0/2041027343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94c4003a50 msgr2=0x7f94cc0dbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.219+0000 7f94be7fc640 1 --2- 172.21.15.43:0/2041027343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94c4003a50 0x7f94cc0dbf80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f94c0032000 tx=0x7f94c0003820 comp rx=0 tx=0).stop 2024-09-17T04:35:00.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.219+0000 7f94d8b8e640 1 -- 172.21.15.43:0/2041027343 reap_dead start 2024-09-17T04:35:00.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.219+0000 7f94be7fc640 1 -- 172.21.15.43:0/2041027343 shutdown_connections 2024-09-17T04:35:00.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.219+0000 7f94be7fc640 1 -- 172.21.15.43:0/2041027343 >> 172.21.15.43:0/2041027343 conn(0x7f94cc04fe30 msgr2=0x7f94cc0d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.219+0000 7f94be7fc640 1 -- 172.21.15.43:0/2041027343 shutdown_connections 2024-09-17T04:35:00.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.220+0000 7f94be7fc640 1 -- 172.21.15.43:0/2041027343 wait complete. 2024-09-17T04:35:00.241 INFO:teuthology.orchestra.run.smithi043.stdout:60129542152 2024-09-17T04:35:00.241 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T04:35:00.242 INFO:teuthology.orchestra.run.smithi043.stdout:60129542151 2024-09-17T04:35:00.242 INFO:teuthology.orchestra.run.smithi043.stdout:68719476743 2024-09-17T04:35:00.243 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T04:35:00.243 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T04:35:00.244 INFO:teuthology.orchestra.run.smithi043.stdout:68719476743 2024-09-17T04:35:00.244 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T04:35:00.245 INFO:teuthology.orchestra.run.smithi043.stdout:68719476743 2024-09-17T04:35:00.245 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T04:35:00.246 INFO:teuthology.orchestra.run.smithi043.stdout:60129542151 2024-09-17T04:35:00.246 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T04:35:00.247 INFO:teuthology.orchestra.run.smithi043.stdout:68719476743 2024-09-17T04:35:00.247 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T04:35:00.248 INFO:teuthology.orchestra.run.smithi043.stdout:60129542152 2024-09-17T04:35:00.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T04:35:00.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.512+0000 7fe0d1951640 1 -- 172.21.15.43:0/452647644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0cc0c5d90 msgr2=0x7fe0cc1538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.512+0000 7fe0d1951640 1 --2- 172.21.15.43:0/452647644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0cc0c5d90 0x7fe0cc1538e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009830 tx=0x7fe0c002e9e0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.512+0000 7f518c207640 1 -- 172.21.15.43:0/2085891156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51840c7560 msgr2=0x7f51840c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.512+0000 7f518c207640 1 --2- 172.21.15.43:0/2085891156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51840c7560 0x7f51840c9000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5184070d80 tx=0x7f517c02aac0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.512+0000 7f518c207640 1 -- 172.21.15.43:0/2085891156 shutdown_connections 2024-09-17T04:35:00.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.512+0000 7f518c207640 1 --2- 172.21.15.43:0/2085891156 >> v2:172.21.15.62:3300/0 conn(0x7f51840b2e30 0x7f518415f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.513+0000 7f518c207640 1 --2- 172.21.15.43:0/2085891156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51840c7560 0x7f51840c9000 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.513+0000 7f518c207640 1 -- 172.21.15.43:0/2085891156 >> 172.21.15.43:0/2085891156 conn(0x7f51840c9660 msgr2=0x7f51840c9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.512+0000 7fe0d1951640 1 -- 172.21.15.43:0/452647644 shutdown_connections 2024-09-17T04:35:00.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.512+0000 7fe0d1951640 1 --2- 172.21.15.43:0/452647644 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0cc0ca590 0x7fe0cc0ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.512+0000 7fe0d1951640 1 --2- 172.21.15.43:0/452647644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0cc0c5d90 0x7fe0cc1538e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.512+0000 7fe0d1951640 1 -- 172.21.15.43:0/452647644 >> 172.21.15.43:0/452647644 conn(0x7fe0cc0cefa0 msgr2=0x7fe0cc0cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.513+0000 7f518c207640 1 -- 172.21.15.43:0/2085891156 shutdown_connections 2024-09-17T04:35:00.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.513+0000 7fe0d1951640 1 -- 172.21.15.43:0/452647644 shutdown_connections 2024-09-17T04:35:00.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.513+0000 7f518c207640 1 -- 172.21.15.43:0/2085891156 wait complete. 2024-09-17T04:35:00.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.513+0000 7fe0d1951640 1 -- 172.21.15.43:0/452647644 wait complete. 2024-09-17T04:35:00.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.515+0000 7f1161293640 1 -- 172.21.15.43:0/403236580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f115c0c9b00 msgr2=0x7f115c070fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.515+0000 7f1161293640 1 --2- 172.21.15.43:0/403236580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f115c0c9b00 0x7f115c070fb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f115c15c6c0 tx=0x7f115402aa10 comp rx=0 tx=0).stop 2024-09-17T04:35:00.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.515+0000 7f5711a1d640 1 -- 172.21.15.43:0/2834014317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5704048ec0 msgr2=0x7f57040d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.515+0000 7f5711a1d640 1 --2- 172.21.15.43:0/2834014317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5704048ec0 0x7f57040d5bc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f56f8009830 tx=0x7f56f802a510 comp rx=0 tx=0).stop 2024-09-17T04:35:00.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.515+0000 7f1161293640 1 -- 172.21.15.43:0/403236580 shutdown_connections 2024-09-17T04:35:00.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.515+0000 7f5711a1d640 1 -- 172.21.15.43:0/2834014317 shutdown_connections 2024-09-17T04:35:00.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.515+0000 7f5711a1d640 1 --2- 172.21.15.43:0/2834014317 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f570404c4e0 0x7f570404c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.515+0000 7f5711a1d640 1 --2- 172.21.15.43:0/2834014317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5704048ec0 0x7f57040d5bc0 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f56f8009830 tx=0x7f56f802a510 comp rx=0 tx=0).stop 2024-09-17T04:35:00.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.515+0000 7f5711a1d640 1 -- 172.21.15.43:0/2834014317 >> 172.21.15.43:0/2834014317 conn(0x7f5704050fa0 msgr2=0x7f57040513b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.515+0000 7f1161293640 1 --2- 172.21.15.43:0/403236580 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f115c155890 0x7f115c155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.515+0000 7f1161293640 1 --2- 172.21.15.43:0/403236580 >> v2:172.21.15.62:3300/0 conn(0x7f115c0c8fc0 0x7f115c0714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.515+0000 7f1161293640 1 --2- 172.21.15.43:0/403236580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f115c0c9b00 0x7f115c070fb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.515+0000 7f1161293640 1 -- 172.21.15.43:0/403236580 >> 172.21.15.43:0/403236580 conn(0x7f115c0cd420 msgr2=0x7f115c0cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.515+0000 7fe0d1951640 1 Processor -- start 2024-09-17T04:35:00.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.515+0000 7f5711a1d640 1 -- 172.21.15.43:0/2834014317 shutdown_connections 2024-09-17T04:35:00.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.516+0000 7fe0d1951640 1 -- start start 2024-09-17T04:35:00.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.516+0000 7f5711a1d640 1 -- 172.21.15.43:0/2834014317 wait complete. 2024-09-17T04:35:00.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.516+0000 7f1161293640 1 -- 172.21.15.43:0/403236580 shutdown_connections 2024-09-17T04:35:00.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.516+0000 7f1161293640 1 -- 172.21.15.43:0/403236580 wait complete. 2024-09-17T04:35:00.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.516+0000 7f4af6c63640 1 -- 172.21.15.43:0/455339614 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ae80e2b70 msgr2=0x7f4ae804d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.516+0000 7f4af6c63640 1 --2- 172.21.15.43:0/455339614 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ae80e2b70 0x7f4ae804d3a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4aec005fd0 tx=0x7f4aec02a530 comp rx=0 tx=0).stop 2024-09-17T04:35:00.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.516+0000 7f4af6c63640 1 -- 172.21.15.43:0/455339614 shutdown_connections 2024-09-17T04:35:00.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.516+0000 7f4af6c63640 1 --2- 172.21.15.43:0/455339614 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ae80e2b70 0x7f4ae804d3a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.516+0000 7f4af6c63640 1 --2- 172.21.15.43:0/455339614 >> v2:172.21.15.43:3300/0 conn(0x7f4ae800d2b0 0x7f4ae80d8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.517+0000 7f4af6c63640 1 -- 172.21.15.43:0/455339614 >> 172.21.15.43:0/455339614 conn(0x7f4ae800e3b0 msgr2=0x7f4ae8051fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.517+0000 7f0876dce640 1 -- 172.21.15.43:0/1185872526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08680469d0 msgr2=0x7f08680db6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.517+0000 7f0876dce640 1 --2- 172.21.15.43:0/1185872526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08680469d0 0x7f08680db6c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0860005fd0 tx=0x7f086002a680 comp rx=0 tx=0).stop 2024-09-17T04:35:00.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.517+0000 7f0876dce640 1 -- 172.21.15.43:0/1185872526 shutdown_connections 2024-09-17T04:35:00.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.516+0000 7f518c207640 1 Processor -- start 2024-09-17T04:35:00.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.516+0000 7f518c207640 1 -- start start 2024-09-17T04:35:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.517+0000 7f0876dce640 1 --2- 172.21.15.43:0/1185872526 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08680d16a0 0x7f0868005c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.517+0000 7f0876dce640 1 --2- 172.21.15.43:0/1185872526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08680469d0 0x7f08680db6c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7f518c207640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51840b2e30 0x7f518414bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7f518c207640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51840c5a00 0x7f518415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7f518c207640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51840c7560 0x7f51841e5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7f518c207640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f518415ef90 con 0x7f51840c7560 2024-09-17T04:35:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7f518c207640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f51840c6e10 con 0x7f51840b2e30 2024-09-17T04:35:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7f518c207640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f518415fcd0 con 0x7f51840c5a00 2024-09-17T04:35:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.519+0000 7f5189fa3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51840b2e30 0x7f518414bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.519+0000 7f5189fa3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51840b2e30 0x7f518414bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:51990/0 (socket says 172.21.15.43:51990) 2024-09-17T04:35:00.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.519+0000 7f5189fa3640 1 -- 172.21.15.43:0/1463492437 learned_addr learned my addr 172.21.15.43:0/1463492437 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:00.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.519+0000 7f1161293640 1 Processor -- start 2024-09-17T04:35:00.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.517+0000 7f4af6c63640 1 -- 172.21.15.43:0/455339614 shutdown_connections 2024-09-17T04:35:00.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7fe0d1951640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0cc0c5d90 0x7fe0cc143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7fe0d1951640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0cc0ca590 0x7fe0cc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7fe0d1951640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0cc0cb490 0x7fe0cc06ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7fe0d1951640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc0c4160 con 0x7fe0cc0cb490 2024-09-17T04:35:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7fe0ca7fc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0cc0ca590 0x7fe0cc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7fe0d1951640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc071530 con 0x7fe0cc0c5d90 2024-09-17T04:35:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7fe0ca7fc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0cc0ca590 0x7fe0cc06e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:60064/0 (socket says 172.21.15.43:60064) 2024-09-17T04:35:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7fe0ca7fc640 1 -- 172.21.15.43:0/659209170 learned_addr learned my addr 172.21.15.43:0/659209170 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7fe0d1951640 1 -- 172.21.15.43:0/659209170 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe0cc0caee0 con 0x7fe0cc0ca590 2024-09-17T04:35:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7fe0cb7fe640 1 --2- 172.21.15.43:0/659209170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0cc0cb490 0x7fe0cc06ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.519+0000 7fe0ca7fc640 1 -- 172.21.15.43:0/659209170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0cc0c5d90 msgr2=0x7fe0cc143630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T04:35:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.519+0000 7fe0ca7fc640 1 --2- 172.21.15.43:0/659209170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0cc0c5d90 0x7fe0cc143630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.519+0000 7fe0ca7fc640 1 -- 172.21.15.43:0/659209170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0cc0cb490 msgr2=0x7fe0cc06ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.519+0000 7fe0ca7fc640 1 --2- 172.21.15.43:0/659209170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0cc0cb490 0x7fe0cc06ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.519+0000 7fe0ca7fc640 1 -- 172.21.15.43:0/659209170 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0cc1401d0 con 0x7fe0cc0ca590 2024-09-17T04:35:00.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.517+0000 7f99b759e640 1 -- 172.21.15.43:0/856394398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99b004e600 msgr2=0x7f99b0049420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.517+0000 7f99b759e640 1 --2- 172.21.15.43:0/856394398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99b004e600 0x7f99b0049420 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f99b000ec20 tx=0x7f99a802a4d0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7f99b759e640 1 -- 172.21.15.43:0/856394398 shutdown_connections 2024-09-17T04:35:00.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7f99b759e640 1 --2- 172.21.15.43:0/856394398 >> v2:172.21.15.43:3300/0 conn(0x7f99b0044dc0 0x7f99b004ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7f99b759e640 1 --2- 172.21.15.43:0/856394398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99b004e600 0x7f99b0049420 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7f99b759e640 1 -- 172.21.15.43:0/856394398 >> 172.21.15.43:0/856394398 conn(0x7f99b000de50 msgr2=0x7f99b000e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7f99b759e640 1 -- 172.21.15.43:0/856394398 shutdown_connections 2024-09-17T04:35:00.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7f99b759e640 1 -- 172.21.15.43:0/856394398 wait complete. 2024-09-17T04:35:00.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.517+0000 7f0876dce640 1 -- 172.21.15.43:0/1185872526 >> 172.21.15.43:0/1185872526 conn(0x7f086804fe30 msgr2=0x7f0868050240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.517+0000 7f0876dce640 1 -- 172.21.15.43:0/1185872526 shutdown_connections 2024-09-17T04:35:00.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.518+0000 7f0876dce640 1 -- 172.21.15.43:0/1185872526 wait complete. 2024-09-17T04:35:00.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.519+0000 7f5711a1d640 1 Processor -- start 2024-09-17T04:35:00.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.519+0000 7f1161293640 1 -- start start 2024-09-17T04:35:00.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.519+0000 7fe0ca7fc640 1 --2- 172.21.15.43:0/659209170 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0cc0ca590 0x7fe0cc06e9f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009950 tx=0x7fe0c003b950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.519+0000 7f51897a2640 1 --2- 172.21.15.43:0/1463492437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51840c5a00 0x7f518415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.517+0000 7f4af6c63640 1 -- 172.21.15.43:0/455339614 wait complete. 2024-09-17T04:35:00.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.520+0000 7fe0b3fff640 1 -- 172.21.15.43:0/659209170 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0040030 con 0x7fe0cc0ca590 2024-09-17T04:35:00.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.520+0000 7fe0b3fff640 1 -- 172.21.15.43:0/659209170 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0c003bb40 con 0x7fe0cc0ca590 2024-09-17T04:35:00.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.519+0000 7f518a7a4640 1 --2- 172.21.15.43:0/1463492437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51840c7560 0x7f51841e5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.520+0000 7f4af6c63640 1 Processor -- start 2024-09-17T04:35:00.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.520+0000 7f518a7a4640 1 -- 172.21.15.43:0/1463492437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51840c5a00 msgr2=0x7f518415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.520+0000 7f518a7a4640 1 --2- 172.21.15.43:0/1463492437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51840c5a00 0x7f518415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.520+0000 7f518a7a4640 1 -- 172.21.15.43:0/1463492437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51840b2e30 msgr2=0x7f518414bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.520+0000 7f518a7a4640 1 --2- 172.21.15.43:0/1463492437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51840b2e30 0x7f518414bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.520+0000 7f518a7a4640 1 -- 172.21.15.43:0/1463492437 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518415e0f0 con 0x7f51840c7560 2024-09-17T04:35:00.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f03f606c640 1 -- 172.21.15.43:0/883036861 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03dc007950 msgr2=0x7f03dc009d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f03f606c640 1 --2- 172.21.15.43:0/883036861 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03dc007950 0x7f03dc009d70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f03e8033730 tx=0x7f03dc003810 comp rx=0 tx=0).stop 2024-09-17T04:35:00.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f03f586b640 1 -- 172.21.15.43:0/883036861 reap_dead start 2024-09-17T04:35:00.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7fe0b3fff640 1 -- 172.21.15.43:0/659209170 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0037040 con 0x7fe0cc0ca590 2024-09-17T04:35:00.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f99b759e640 1 Processor -- start 2024-09-17T04:35:00.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f518a7a4640 1 --2- 172.21.15.43:0/1463492437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51840c7560 0x7f51841e5850 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f51840c5760 tx=0x7f518000b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7fe0d1951640 1 -- 172.21.15.43:0/659209170 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0cc14ee00 con 0x7fe0cc0ca590 2024-09-17T04:35:00.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f0876dce640 1 Processor -- start 2024-09-17T04:35:00.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7fe0d1951640 1 -- 172.21.15.43:0/659209170 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0cc14d260 con 0x7fe0cc0ca590 2024-09-17T04:35:00.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f0876dce640 1 -- start start 2024-09-17T04:35:00.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f517a7fc640 1 -- 172.21.15.43:0/1463492437 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180014070 con 0x7f51840c7560 2024-09-17T04:35:00.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f517a7fc640 1 -- 172.21.15.43:0/1463492437 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51800104f0 con 0x7f51840c7560 2024-09-17T04:35:00.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f517a7fc640 1 -- 172.21.15.43:0/1463492437 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180010940 con 0x7f51840c7560 2024-09-17T04:35:00.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f03f606c640 1 -- 172.21.15.43:0/883036861 shutdown_connections 2024-09-17T04:35:00.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f03f606c640 1 -- 172.21.15.43:0/883036861 >> 172.21.15.43:0/883036861 conn(0x7f03e804fe30 msgr2=0x7f03e8050240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f518c207640 1 -- 172.21.15.43:0/1463492437 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51841e4e40 con 0x7f51840c7560 2024-09-17T04:35:00.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f518c207640 1 -- 172.21.15.43:0/1463492437 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51841f5560 con 0x7f51840c7560 2024-09-17T04:35:00.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.520+0000 7f5711a1d640 1 -- start start 2024-09-17T04:35:00.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f5711a1d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5704048970 0x7f57040d3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f5711a1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f570404c4e0 0x7f5704033740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f5711a1d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5704043d20 0x7f57040c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f5711a1d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5704049940 con 0x7f5704043d20 2024-09-17T04:35:00.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f5711a1d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5704049660 con 0x7f570404c4e0 2024-09-17T04:35:00.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f5711a1d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f570404d760 con 0x7f5704048970 2024-09-17T04:35:00.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f03f606c640 1 -- 172.21.15.43:0/883036861 shutdown_connections 2024-09-17T04:35:00.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f571121c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5704043d20 0x7f57040c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f571121c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5704043d20 0x7f57040c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35332/0 (socket says 172.21.15.43:35332) 2024-09-17T04:35:00.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f571121c640 1 -- 172.21.15.43:0/1172673842 learned_addr learned my addr 172.21.15.43:0/1172673842 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:00.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.520+0000 7f4af6c63640 1 -- start start 2024-09-17T04:35:00.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f1161293640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c0c8fc0 0x7f115c1514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f1161293640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f115c155890 0x7f115c0cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f1161293640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f115c0cc090 0x7f115c0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f1161293640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f115c0c7370 con 0x7f115c0cc090 2024-09-17T04:35:00.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f1161293640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f115c15c3e0 con 0x7f115c0c8fc0 2024-09-17T04:35:00.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f1161293640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f115c0c6e70 con 0x7f115c155890 2024-09-17T04:35:00.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f115affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c0c8fc0 0x7f115c1514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f115affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c0c8fc0 0x7f115c1514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:51992/0 (socket says 172.21.15.43:51992) 2024-09-17T04:35:00.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f115affd640 1 -- 172.21.15.43:0/2424195740 learned_addr learned my addr 172.21.15.43:0/2424195740 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:00.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f115b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f115c0cc090 0x7f115c0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f115a7fc640 1 --2- 172.21.15.43:0/2424195740 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f115c155890 0x7f115c0cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f115affd640 1 -- 172.21.15.43:0/2424195740 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f115c155890 msgr2=0x7f115c0cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.522+0000 7f115affd640 1 --2- 172.21.15.43:0/2424195740 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f115c155890 0x7f115c0cbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f115affd640 1 -- 172.21.15.43:0/2424195740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f115c0cc090 msgr2=0x7f115c0cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f115affd640 1 --2- 172.21.15.43:0/2424195740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f115c0cc090 0x7f115c0cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f115affd640 1 -- 172.21.15.43:0/2424195740 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115c0731e0 con 0x7f115c0c8fc0 2024-09-17T04:35:00.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f115affd640 1 --2- 172.21.15.43:0/2424195740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c0c8fc0 0x7f115c1514c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1154009bf0 tx=0x7f11540042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.524+0000 7f11537fe640 1 -- 172.21.15.43:0/2424195740 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154033050 con 0x7f115c0c8fc0 2024-09-17T04:35:00.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.524+0000 7f11537fe640 1 -- 172.21.15.43:0/2424195740 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11540046f0 con 0x7f115c0c8fc0 2024-09-17T04:35:00.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.524+0000 7f11537fe640 1 -- 172.21.15.43:0/2424195740 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11540496c0 con 0x7f115c0c8fc0 2024-09-17T04:35:00.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.524+0000 7f1161293640 1 -- 172.21.15.43:0/2424195740 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f115c159790 con 0x7f115c0c8fc0 2024-09-17T04:35:00.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.521+0000 7f99b759e640 1 -- start start 2024-09-17T04:35:00.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f99b759e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99b0044dc0 0x7f99b0008290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f99b759e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99b004e600 0x7f99b017ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f99b659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99b0044dc0 0x7f99b0008290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f99b659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99b0044dc0 0x7f99b0008290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:51998/0 (socket says 172.21.15.43:51998) 2024-09-17T04:35:00.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f99b659c640 1 -- 172.21.15.43:0/486112176 learned_addr learned my addr 172.21.15.43:0/486112176 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:00.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f99b5d9b640 1 --2- 172.21.15.43:0/486112176 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99b004e600 0x7f99b017ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f99b759e640 1 --2- 172.21.15.43:0/486112176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99b004f2a0 0x7f99b00d3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.524+0000 7f99b759e640 1 -- 172.21.15.43:0/486112176 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f99b00df520 con 0x7f99b004f2a0 2024-09-17T04:35:00.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.524+0000 7f99b759e640 1 -- 172.21.15.43:0/486112176 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f99b00df240 con 0x7f99b0044dc0 2024-09-17T04:35:00.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.524+0000 7f99b759e640 1 -- 172.21.15.43:0/486112176 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f99b00451d0 con 0x7f99b004e600 2024-09-17T04:35:00.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.524+0000 7f99b6d9d640 1 --2- 172.21.15.43:0/486112176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99b004f2a0 0x7f99b00d3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f03f606c640 1 -- 172.21.15.43:0/883036861 wait complete. 2024-09-17T04:35:00.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.524+0000 7f1161293640 1 -- 172.21.15.43:0/2424195740 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f115c0cb2c0 con 0x7f115c0c8fc0 2024-09-17T04:35:00.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f571121c640 1 -- 172.21.15.43:0/1172673842 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5704048970 msgr2=0x7f57040d3470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:35:00.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f571121c640 1 --2- 172.21.15.43:0/1172673842 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5704048970 0x7f57040d3470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f571121c640 1 -- 172.21.15.43:0/1172673842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f570404c4e0 msgr2=0x7f5704033740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:35:00.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f571121c640 1 --2- 172.21.15.43:0/1172673842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f570404c4e0 0x7f5704033740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f571121c640 1 -- 172.21.15.43:0/1172673842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5704008e10 con 0x7f5704043d20 2024-09-17T04:35:00.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.524+0000 7fe0b3fff640 1 -- 172.21.15.43:0/659209170 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe0c003a070 con 0x7fe0cc0ca590 2024-09-17T04:35:00.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f4af6c63640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ae800d2b0 0x7f4ae8169200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.523+0000 7f4af6c63640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ae804d8e0 0x7f4ae8051470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.525+0000 7f518c207640 1 -- 172.21.15.43:0/1463492437 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f516c005290 con 0x7f51840c7560 2024-09-17T04:35:00.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.525+0000 7f4af5460640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ae804d8e0 0x7f4ae8051470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.525+0000 7f4af5460640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ae804d8e0 0x7f4ae8051470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35374/0 (socket says 172.21.15.43:35374) 2024-09-17T04:35:00.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.525+0000 7f4af6c63640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ae80e2b70 0x7f4ae8044260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.525+0000 7f4af6c63640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae804ce80 con 0x7f4ae804d8e0 2024-09-17T04:35:00.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.525+0000 7f4af6c63640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae804cba0 con 0x7f4ae80e2b70 2024-09-17T04:35:00.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.525+0000 7f4af6c63640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae804a8d0 con 0x7f4ae800d2b0 2024-09-17T04:35:00.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.525+0000 7f4af5460640 1 -- 172.21.15.43:0/1979470712 learned_addr learned my addr 172.21.15.43:0/1979470712 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:00.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.525+0000 7f571121c640 1 --2- 172.21.15.43:0/1172673842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5704043d20 0x7f57040c8200 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f570000d650 tx=0x7f570000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.525+0000 7f4af5460640 1 -- 172.21.15.43:0/1979470712 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ae800d2b0 msgr2=0x7f4ae8169200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.525+0000 7f4af5460640 1 --2- 172.21.15.43:0/1979470712 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ae800d2b0 0x7f4ae8169200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.525+0000 7f4af5460640 1 -- 172.21.15.43:0/1979470712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ae80e2b70 msgr2=0x7f4ae8044260 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T04:35:00.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.525+0000 7f4af5460640 1 --2- 172.21.15.43:0/1979470712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ae80e2b70 0x7f4ae8044260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.525+0000 7f4af5460640 1 -- 172.21.15.43:0/1979470712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae8045fb0 con 0x7f4ae804d8e0 2024-09-17T04:35:00.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f57097fa640 1 -- 172.21.15.43:0/1172673842 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700017070 con 0x7f5704043d20 2024-09-17T04:35:00.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f4af5460640 1 --2- 172.21.15.43:0/1979470712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ae804d8e0 0x7f4ae8051470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4aec034040 tx=0x7f4aec003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f517a7fc640 1 -- 172.21.15.43:0/1463492437 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5180017070 con 0x7f51840c7560 2024-09-17T04:35:00.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.527+0000 7f517a7fc640 1 --2- 172.21.15.43:0/1463492437 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5168078c60 0x7f516807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f11517fa640 1 -- 172.21.15.43:0/2424195740 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1134005290 con 0x7f115c0c8fc0 2024-09-17T04:35:00.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7fe0b3fff640 1 --2- 172.21.15.43:0/659209170 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe0b8078b90 0x7fe0b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7fe0b3fff640 1 -- 172.21.15.43:0/659209170 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe0c00bbd80 con 0x7fe0cc0ca590 2024-09-17T04:35:00.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7fe0b1ffb640 1 -- 172.21.15.43:0/659209170 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0cc0c8f30 con 0x7fe0cc0ca590 2024-09-17T04:35:00.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7fe0caffd640 1 --2- 172.21.15.43:0/659209170 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe0b8078b90 0x7fe0b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f99b5d9b640 1 -- 172.21.15.43:0/486112176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99b0044dc0 msgr2=0x7f99b0008290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f99b5d9b640 1 --2- 172.21.15.43:0/486112176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99b0044dc0 0x7f99b0008290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f99b5d9b640 1 -- 172.21.15.43:0/486112176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99b004f2a0 msgr2=0x7f99b00d3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f99b5d9b640 1 --2- 172.21.15.43:0/486112176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99b004f2a0 0x7f99b00d3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f99b5d9b640 1 -- 172.21.15.43:0/486112176 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b017d350 con 0x7f99b004e600 2024-09-17T04:35:00.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f03f606c640 1 Processor -- start 2024-09-17T04:35:00.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f03f606c640 1 -- start start 2024-09-17T04:35:00.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f5711a1d640 1 -- 172.21.15.43:0/1172673842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57040c9cb0 con 0x7f5704043d20 2024-09-17T04:35:00.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f5711a1d640 1 -- 172.21.15.43:0/1172673842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5704164a50 con 0x7f5704043d20 2024-09-17T04:35:00.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.527+0000 7f57097fa640 1 -- 172.21.15.43:0/1172673842 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5700005310 con 0x7f5704043d20 2024-09-17T04:35:00.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.527+0000 7f57097fa640 1 -- 172.21.15.43:0/1172673842 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700009820 con 0x7f5704043d20 2024-09-17T04:35:00.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.524+0000 7f0876dce640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0868044cb0 0x7f0868161ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.524+0000 7f0876dce640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08680469d0 0x7f0868160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.524+0000 7f0876dce640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08680d16a0 0x7f0868005c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.524+0000 7f0876dce640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0868045ef0 con 0x7f0868044cb0 2024-09-17T04:35:00.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.524+0000 7f0876dce640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0868045c10 con 0x7f08680469d0 2024-09-17T04:35:00.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.524+0000 7f0876dce640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f08680461d0 con 0x7f08680d16a0 2024-09-17T04:35:00.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.525+0000 7f0875dcc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0868044cb0 0x7f0868161ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.525+0000 7f0875dcc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0868044cb0 0x7f0868161ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35358/0 (socket says 172.21.15.43:35358) 2024-09-17T04:35:00.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.525+0000 7f0875dcc640 1 -- 172.21.15.43:0/3295130482 learned_addr learned my addr 172.21.15.43:0/3295130482 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:00.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f08765cd640 1 --2- 172.21.15.43:0/3295130482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08680d16a0 0x7f0868005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f0875dcc640 1 -- 172.21.15.43:0/3295130482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08680d16a0 msgr2=0x7f0868005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f0875dcc640 1 --2- 172.21.15.43:0/3295130482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08680d16a0 0x7f0868005c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f0875dcc640 1 -- 172.21.15.43:0/3295130482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08680469d0 msgr2=0x7f0868160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f0875dcc640 1 --2- 172.21.15.43:0/3295130482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08680469d0 0x7f0868160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f0875dcc640 1 -- 172.21.15.43:0/3295130482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0868162c70 con 0x7f0868044cb0 2024-09-17T04:35:00.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f08765cd640 1 --2- 172.21.15.43:0/3295130482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08680d16a0 0x7f0868005c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:35:00.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.526+0000 7f0875dcc640 1 --2- 172.21.15.43:0/3295130482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0868044cb0 0x7f0868161ec0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f086c00c370 tx=0x7f086c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.527+0000 7f517a7fc640 1 -- 172.21.15.43:0/1463492437 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f518009a270 con 0x7f51840c7560 2024-09-17T04:35:00.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.527+0000 7f5189fa3640 1 --2- 172.21.15.43:0/1463492437 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5168078c60 0x7f516807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.527+0000 7f99b5d9b640 1 --2- 172.21.15.43:0/486112176 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99b004e600 0x7f99b017ce10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00e710 tx=0x7f99ac00ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.527+0000 7fe0caffd640 1 --2- 172.21.15.43:0/659209170 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe0b8078b90 0x7fe0b807b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4001fa0 tx=0x7fe0c4001590 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.527+0000 7f4ae67fc640 1 -- 172.21.15.43:0/1979470712 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec03e030 con 0x7f4ae804d8e0 2024-09-17T04:35:00.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f4af6c63640 1 -- 172.21.15.43:0/1979470712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae8047990 con 0x7f4ae804d8e0 2024-09-17T04:35:00.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f4af6c63640 1 -- 172.21.15.43:0/1979470712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae8047f50 con 0x7f4ae804d8e0 2024-09-17T04:35:00.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f11537fe640 1 -- 172.21.15.43:0/2424195740 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1154036070 con 0x7f115c0c8fc0 2024-09-17T04:35:00.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f5711a1d640 1 -- 172.21.15.43:0/1172673842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ec005290 con 0x7f5704043d20 2024-09-17T04:35:00.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f03f606c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03dc007950 0x7f03e80cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f5189fa3640 1 --2- 172.21.15.43:0/1463492437 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5168078c60 0x7f516807b170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f517c000f80 tx=0x7f517c038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f03f606c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03e80d2b90 0x7f03e80d66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f03f606c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03e817caa0 0x7f03e817ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f03f606c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f03e8045ef0 con 0x7f03dc007950 2024-09-17T04:35:00.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f03f606c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f03e8045c10 con 0x7f03e817caa0 2024-09-17T04:35:00.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f03f606c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f03e80461d0 con 0x7f03e80d2b90 2024-09-17T04:35:00.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f03f506a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03dc007950 0x7f03e80cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f03f506a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03dc007950 0x7f03e80cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35380/0 (socket says 172.21.15.43:35380) 2024-09-17T04:35:00.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f03f506a640 1 -- 172.21.15.43:0/3241288021 learned_addr learned my addr 172.21.15.43:0/3241288021 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:00.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f11537fe640 1 --2- 172.21.15.43:0/2424195740 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f113c078c60 0x7f113c07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f03f586b640 1 --2- 172.21.15.43:0/3241288021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03e817caa0 0x7f03e817ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f03f4869640 1 --2- 172.21.15.43:0/3241288021 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03e80d2b90 0x7f03e80d66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.528+0000 7f11537fe640 1 -- 172.21.15.43:0/2424195740 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f11540cd3f0 con 0x7f115c0c8fc0 2024-09-17T04:35:00.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.529+0000 7f115a7fc640 1 --2- 172.21.15.43:0/2424195740 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f113c078c60 0x7f113c07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.529+0000 7f4af6c63640 1 -- 172.21.15.43:0/1979470712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae804dd10 con 0x7f4ae804d8e0 2024-09-17T04:35:00.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.529+0000 7f03f586b640 1 -- 172.21.15.43:0/3241288021 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03e80d2b90 msgr2=0x7f03e80d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.529+0000 7f03f586b640 1 --2- 172.21.15.43:0/3241288021 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03e80d2b90 0x7f03e80d66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.529+0000 7f03f586b640 1 -- 172.21.15.43:0/3241288021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03dc007950 msgr2=0x7f03e80cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.529+0000 7f03f586b640 1 --2- 172.21.15.43:0/3241288021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03dc007950 0x7f03e80cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.529+0000 7f03f586b640 1 -- 172.21.15.43:0/3241288021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e80d2750 con 0x7f03e817caa0 2024-09-17T04:35:00.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.529+0000 7f03f506a640 1 --2- 172.21.15.43:0/3241288021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03dc007950 0x7f03e80cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:35:00.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.529+0000 7f03f586b640 1 --2- 172.21.15.43:0/3241288021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03e817caa0 0x7f03e817ceb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f03f006c720 tx=0x7f03f0075710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.529+0000 7f115a7fc640 1 --2- 172.21.15.43:0/2424195740 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f113c078c60 0x7f113c07b170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f11440058c0 tx=0x7f1144005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.532+0000 7f99a6ffd640 1 -- 172.21.15.43:0/486112176 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00cab0 con 0x7f99b004e600 2024-09-17T04:35:00.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.532+0000 7f99a6ffd640 1 -- 172.21.15.43:0/486112176 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99ac00cc50 con 0x7f99b004e600 2024-09-17T04:35:00.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.532+0000 7f99a6ffd640 1 -- 172.21.15.43:0/486112176 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac010430 con 0x7f99b004e600 2024-09-17T04:35:00.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.532+0000 7f99b759e640 1 -- 172.21.15.43:0/486112176 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b0179e30 con 0x7f99b004e600 2024-09-17T04:35:00.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.532+0000 7f99b759e640 1 -- 172.21.15.43:0/486112176 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b004b310 con 0x7f99b004e600 2024-09-17T04:35:00.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.532+0000 7fe0b3fff640 1 -- 172.21.15.43:0/659209170 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe0c0083b60 con 0x7fe0cc0ca590 2024-09-17T04:35:00.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.532+0000 7f517a7fc640 1 -- 172.21.15.43:0/1463492437 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5180062160 con 0x7f51840c7560 2024-09-17T04:35:00.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.533+0000 7f08667fc640 1 -- 172.21.15.43:0/3295130482 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c0052d0 con 0x7f0868044cb0 2024-09-17T04:35:00.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.533+0000 7f08667fc640 1 -- 172.21.15.43:0/3295130482 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f086c007020 con 0x7f0868044cb0 2024-09-17T04:35:00.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.533+0000 7f0876dce640 1 -- 172.21.15.43:0/3295130482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0868171d80 con 0x7f0868044cb0 2024-09-17T04:35:00.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.533+0000 7f0876dce640 1 -- 172.21.15.43:0/3295130482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0868162f50 con 0x7f0868044cb0 2024-09-17T04:35:00.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.533+0000 7f08667fc640 1 -- 172.21.15.43:0/3295130482 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c007470 con 0x7f0868044cb0 2024-09-17T04:35:00.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.534+0000 7f4ae67fc640 1 -- 172.21.15.43:0/1979470712 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4aec005310 con 0x7f4ae804d8e0 2024-09-17T04:35:00.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.534+0000 7f4ae67fc640 1 -- 172.21.15.43:0/1979470712 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec048060 con 0x7f4ae804d8e0 2024-09-17T04:35:00.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.534+0000 7f11537fe640 1 -- 172.21.15.43:0/2424195740 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f11540958a0 con 0x7f115c0c8fc0 2024-09-17T04:35:00.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.535+0000 7f0876dce640 1 -- 172.21.15.43:0/3295130482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08680d5200 con 0x7f0868044cb0 2024-09-17T04:35:00.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.535+0000 7f99a6ffd640 1 -- 172.21.15.43:0/486112176 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99ac0107e0 con 0x7f99b004e600 2024-09-17T04:35:00.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.536+0000 7f99b759e640 1 -- 172.21.15.43:0/486112176 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f999c005290 con 0x7f99b004e600 2024-09-17T04:35:00.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.534+0000 7f03e5ffb640 1 -- 172.21.15.43:0/3241288021 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f006b230 con 0x7f03e817caa0 2024-09-17T04:35:00.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.534+0000 7f03e5ffb640 1 -- 172.21.15.43:0/3241288021 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03f00963f0 con 0x7f03e817caa0 2024-09-17T04:35:00.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.534+0000 7f03f606c640 1 -- 172.21.15.43:0/3241288021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03e817d6d0 con 0x7f03e817caa0 2024-09-17T04:35:00.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.534+0000 7f03e5ffb640 1 -- 172.21.15.43:0/3241288021 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f0096840 con 0x7f03e817caa0 2024-09-17T04:35:00.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.535+0000 7f03f606c640 1 -- 172.21.15.43:0/3241288021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03e8049d50 con 0x7f03e817caa0 2024-09-17T04:35:00.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.535+0000 7f57097fa640 1 -- 172.21.15.43:0/1172673842 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f57000099c0 con 0x7f5704043d20 2024-09-17T04:35:00.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.536+0000 7f99a6ffd640 1 --2- 172.21.15.43:0/486112176 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9998078b90 0x7f999807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.536+0000 7f99a6ffd640 1 -- 172.21.15.43:0/486112176 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f99ac09b900 con 0x7f99b004e600 2024-09-17T04:35:00.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.536+0000 7f57097fa640 1 --2- 172.21.15.43:0/1172673842 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56f0078c60 0x7f56f007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.536+0000 7f99b659c640 1 --2- 172.21.15.43:0/486112176 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9998078b90 0x7f999807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.536+0000 7f5710a1b640 1 --2- 172.21.15.43:0/1172673842 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56f0078c60 0x7f56f007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.537+0000 7f57097fa640 1 -- 172.21.15.43:0/1172673842 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f570009b160 con 0x7f5704043d20 2024-09-17T04:35:00.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.538+0000 7f99b659c640 1 --2- 172.21.15.43:0/486112176 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9998078b90 0x7f999807b0a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f99a80095f0 tx=0x7f99a80046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.537+0000 7f03f606c640 1 -- 172.21.15.43:0/3241288021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03e800de50 con 0x7f03e817caa0 2024-09-17T04:35:00.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.537+0000 7f03e5ffb640 1 -- 172.21.15.43:0/3241288021 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f03f0074050 con 0x7f03e817caa0 2024-09-17T04:35:00.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.538+0000 7f5710a1b640 1 --2- 172.21.15.43:0/1172673842 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56f0078c60 0x7f56f007b170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f570c0521d0 tx=0x7f570c07c700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.538+0000 7f03e5ffb640 1 --2- 172.21.15.43:0/3241288021 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f03d4078c30 0x7f03d407b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.538+0000 7f03e5ffb640 1 -- 172.21.15.43:0/3241288021 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f03f0117540 con 0x7f03e817caa0 2024-09-17T04:35:00.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.538+0000 7f03f506a640 1 --2- 172.21.15.43:0/3241288021 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f03d4078c30 0x7f03d407b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.538+0000 7f4ae67fc640 1 -- 172.21.15.43:0/1979470712 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4aec041030 con 0x7f4ae804d8e0 2024-09-17T04:35:00.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.539+0000 7f03f506a640 1 --2- 172.21.15.43:0/3241288021 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f03d4078c30 0x7f03d407b140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f03ec001cd0 tx=0x7f03ec0011e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.539+0000 7f4ae67fc640 1 --2- 172.21.15.43:0/1979470712 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4ad4078b90 0x7f4ad407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.539+0000 7f4af5c61640 1 --2- 172.21.15.43:0/1979470712 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4ad4078b90 0x7f4ad407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.540+0000 7f4af5c61640 1 --2- 172.21.15.43:0/1979470712 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4ad4078b90 0x7f4ad407b0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000b980 tx=0x7f4ae0005ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.541+0000 7f99a6ffd640 1 -- 172.21.15.43:0/486112176 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f99ac063650 con 0x7f99b004e600 2024-09-17T04:35:00.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.543+0000 7f03e5ffb640 1 -- 172.21.15.43:0/3241288021 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f03f009c060 con 0x7f03e817caa0 2024-09-17T04:35:00.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.544+0000 7f57097fa640 1 -- 172.21.15.43:0/1172673842 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5700063580 con 0x7f5704043d20 2024-09-17T04:35:00.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.546+0000 7f08667fc640 1 -- 172.21.15.43:0/3295130482 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f086c0067d0 con 0x7f0868044cb0 2024-09-17T04:35:00.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.547+0000 7f4ae67fc640 1 -- 172.21.15.43:0/1979470712 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4aec07fa80 con 0x7f4ae804d8e0 2024-09-17T04:35:00.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.547+0000 7f08667fc640 1 --2- 172.21.15.43:0/3295130482 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0854078b90 0x7f085407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:00.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.548+0000 7f08667fc640 1 -- 172.21.15.43:0/3295130482 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f086c007610 con 0x7f0868044cb0 2024-09-17T04:35:00.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.548+0000 7f08755cb640 1 --2- 172.21.15.43:0/3295130482 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0854078b90 0x7f085407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:00.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.555+0000 7f4ae67fc640 1 -- 172.21.15.43:0/1979470712 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4aec083f10 con 0x7f4ae804d8e0 2024-09-17T04:35:00.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.556+0000 7f08755cb640 1 --2- 172.21.15.43:0/3295130482 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0854078b90 0x7f085407b0a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0860032000 tx=0x7f08600046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:00.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.564+0000 7f08667fc640 1 -- 172.21.15.43:0/3295130482 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f086c062b30 con 0x7f0868044cb0 2024-09-17T04:35:00.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.956+0000 7fe0b1ffb640 1 -- 172.21.15.43:0/659209170 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe0cc141920 con 0x7fe0cc0ca590 2024-09-17T04:35:00.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.957+0000 7fe0b3fff640 1 -- 172.21.15.43:0/659209170 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe0c0088590 con 0x7fe0cc0ca590 2024-09-17T04:35:00.957 INFO:teuthology.orchestra.run.smithi043.stdout:68719476742 2024-09-17T04:35:00.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.958+0000 7f518c207640 1 -- 172.21.15.43:0/1463492437 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f516c005580 con 0x7f51840c7560 2024-09-17T04:35:00.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.959+0000 7f517a7fc640 1 -- 172.21.15.43:0/1463492437 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5180066b90 con 0x7f51840c7560 2024-09-17T04:35:00.959 INFO:teuthology.orchestra.run.smithi043.stdout:60129542150 2024-09-17T04:35:00.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.961+0000 7fe0d1951640 1 -- 172.21.15.43:0/659209170 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe0b8078b90 msgr2=0x7fe0b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.961+0000 7fe0d1951640 1 --2- 172.21.15.43:0/659209170 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe0b8078b90 0x7fe0b807b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4001fa0 tx=0x7fe0c4001590 comp rx=0 tx=0).stop 2024-09-17T04:35:00.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.961+0000 7fe0d1951640 1 -- 172.21.15.43:0/659209170 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0cc0ca590 msgr2=0x7fe0cc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.961+0000 7f11517fa640 1 -- 172.21.15.43:0/2424195740 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1134005580 con 0x7f115c0c8fc0 2024-09-17T04:35:00.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.961+0000 7fe0d1951640 1 --2- 172.21.15.43:0/659209170 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0cc0ca590 0x7fe0cc06e9f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009950 tx=0x7fe0c003b950 comp rx=0 tx=0).stop 2024-09-17T04:35:00.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.961+0000 7fe0d1951640 1 -- 172.21.15.43:0/659209170 shutdown_connections 2024-09-17T04:35:00.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.962+0000 7fe0d1951640 1 --2- 172.21.15.43:0/659209170 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe0b8078b90 0x7fe0b807b0a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.962+0000 7fe0d1951640 1 --2- 172.21.15.43:0/659209170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0cc0cb490 0x7fe0cc06ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.962+0000 7fe0d1951640 1 --2- 172.21.15.43:0/659209170 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0cc0ca590 0x7fe0cc06e9f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.962+0000 7fe0d1951640 1 --2- 172.21.15.43:0/659209170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0cc0c5d90 0x7fe0cc143630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.962+0000 7fe0d1951640 1 -- 172.21.15.43:0/659209170 >> 172.21.15.43:0/659209170 conn(0x7fe0cc0cefa0 msgr2=0x7fe0cc158350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.962+0000 7fe0d1951640 1 -- 172.21.15.43:0/659209170 shutdown_connections 2024-09-17T04:35:00.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.962+0000 7fe0d1951640 1 -- 172.21.15.43:0/659209170 wait complete. 2024-09-17T04:35:00.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.963+0000 7f11537fe640 1 -- 172.21.15.43:0/2424195740 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f11540951a0 con 0x7f115c0c8fc0 2024-09-17T04:35:00.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.963+0000 7f518c207640 1 -- 172.21.15.43:0/1463492437 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5168078c60 msgr2=0x7f516807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.964 INFO:teuthology.orchestra.run.smithi043.stdout:68719476742 2024-09-17T04:35:00.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.963+0000 7f518c207640 1 --2- 172.21.15.43:0/1463492437 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5168078c60 0x7f516807b170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f517c000f80 tx=0x7f517c038040 comp rx=0 tx=0).stop 2024-09-17T04:35:00.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.963+0000 7f518c207640 1 -- 172.21.15.43:0/1463492437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51840c7560 msgr2=0x7f51841e5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.963+0000 7f518c207640 1 --2- 172.21.15.43:0/1463492437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51840c7560 0x7f51841e5850 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f51840c5760 tx=0x7f518000b9b0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.963+0000 7f518c207640 1 -- 172.21.15.43:0/1463492437 shutdown_connections 2024-09-17T04:35:00.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.963+0000 7f518c207640 1 --2- 172.21.15.43:0/1463492437 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5168078c60 0x7f516807b170 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.964+0000 7f518c207640 1 --2- 172.21.15.43:0/1463492437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51840c7560 0x7f51841e5850 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.964+0000 7f518c207640 1 --2- 172.21.15.43:0/1463492437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51840c5a00 0x7f518415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.964+0000 7f518c207640 1 --2- 172.21.15.43:0/1463492437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51840b2e30 0x7f518414bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.964+0000 7f518c207640 1 -- 172.21.15.43:0/1463492437 >> 172.21.15.43:0/1463492437 conn(0x7f51840c9660 msgr2=0x7f51841487d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.964+0000 7f518c207640 1 -- 172.21.15.43:0/1463492437 shutdown_connections 2024-09-17T04:35:00.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.964+0000 7f518c207640 1 -- 172.21.15.43:0/1463492437 wait complete. 2024-09-17T04:35:00.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.966+0000 7f5711a1d640 1 -- 172.21.15.43:0/1172673842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f56ec005850 con 0x7f5704043d20 2024-09-17T04:35:00.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.967+0000 7f11517fa640 1 -- 172.21.15.43:0/2424195740 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f113c078c60 msgr2=0x7f113c07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.967+0000 7f11517fa640 1 --2- 172.21.15.43:0/2424195740 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f113c078c60 0x7f113c07b170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f11440058c0 tx=0x7f1144005850 comp rx=0 tx=0).stop 2024-09-17T04:35:00.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.967+0000 7f11517fa640 1 -- 172.21.15.43:0/2424195740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c0c8fc0 msgr2=0x7f115c1514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.967+0000 7f11517fa640 1 --2- 172.21.15.43:0/2424195740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c0c8fc0 0x7f115c1514c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1154009bf0 tx=0x7f11540042f0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.967+0000 7f11517fa640 1 -- 172.21.15.43:0/2424195740 shutdown_connections 2024-09-17T04:35:00.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.967+0000 7f11517fa640 1 --2- 172.21.15.43:0/2424195740 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f113c078c60 0x7f113c07b170 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f11440058c0 tx=0x7f1144005850 comp rx=0 tx=0).stop 2024-09-17T04:35:00.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.967+0000 7f11517fa640 1 --2- 172.21.15.43:0/2424195740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f115c0cc090 0x7f115c0cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.967+0000 7f57097fa640 1 -- 172.21.15.43:0/1172673842 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5700062e80 con 0x7f5704043d20 2024-09-17T04:35:00.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.967+0000 7f11517fa640 1 --2- 172.21.15.43:0/2424195740 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f115c155890 0x7f115c0cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.967+0000 7f11517fa640 1 --2- 172.21.15.43:0/2424195740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c0c8fc0 0x7f115c1514c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.967+0000 7f11517fa640 1 -- 172.21.15.43:0/2424195740 >> 172.21.15.43:0/2424195740 conn(0x7f115c0cd420 msgr2=0x7f115c073950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.968 INFO:teuthology.orchestra.run.smithi043.stdout:68719476742 2024-09-17T04:35:00.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.967+0000 7f11517fa640 1 -- 172.21.15.43:0/2424195740 shutdown_connections 2024-09-17T04:35:00.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.968+0000 7f11517fa640 1 -- 172.21.15.43:0/2424195740 wait complete. 2024-09-17T04:35:00.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.969+0000 7f99b759e640 1 -- 172.21.15.43:0/486112176 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f999c005580 con 0x7f99b004e600 2024-09-17T04:35:00.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.971+0000 7f99a6ffd640 1 -- 172.21.15.43:0/486112176 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f99ac09b070 con 0x7f99b004e600 2024-09-17T04:35:00.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.971+0000 7f5711a1d640 1 -- 172.21.15.43:0/1172673842 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56f0078c60 msgr2=0x7f56f007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.971+0000 7f5711a1d640 1 --2- 172.21.15.43:0/1172673842 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56f0078c60 0x7f56f007b170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f570c0521d0 tx=0x7f570c07c700 comp rx=0 tx=0).stop 2024-09-17T04:35:00.971 INFO:teuthology.orchestra.run.smithi043.stdout:68719476742 2024-09-17T04:35:00.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.971+0000 7f03f606c640 1 -- 172.21.15.43:0/3241288021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f03e804a9d0 con 0x7f03e817caa0 2024-09-17T04:35:00.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.971+0000 7f5711a1d640 1 -- 172.21.15.43:0/1172673842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5704043d20 msgr2=0x7f57040c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.971+0000 7f5711a1d640 1 --2- 172.21.15.43:0/1172673842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5704043d20 0x7f57040c8200 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f570000d650 tx=0x7f570000db10 comp rx=0 tx=0).stop 2024-09-17T04:35:00.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.971+0000 7f5711a1d640 1 -- 172.21.15.43:0/1172673842 shutdown_connections 2024-09-17T04:35:00.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.971+0000 7f5711a1d640 1 --2- 172.21.15.43:0/1172673842 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56f0078c60 0x7f56f007b170 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.971+0000 7f5711a1d640 1 --2- 172.21.15.43:0/1172673842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f570404c4e0 0x7f5704033740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.971+0000 7f5711a1d640 1 --2- 172.21.15.43:0/1172673842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5704043d20 0x7f57040c8200 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.971+0000 7f5711a1d640 1 --2- 172.21.15.43:0/1172673842 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5704048970 0x7f57040d3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.971+0000 7f5711a1d640 1 -- 172.21.15.43:0/1172673842 >> 172.21.15.43:0/1172673842 conn(0x7f5704050fa0 msgr2=0x7f57040cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.972+0000 7f03e5ffb640 1 -- 172.21.15.43:0/3241288021 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f03f00dfa80 con 0x7f03e817caa0 2024-09-17T04:35:00.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.972+0000 7f5711a1d640 1 -- 172.21.15.43:0/1172673842 shutdown_connections 2024-09-17T04:35:00.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.972+0000 7f5711a1d640 1 -- 172.21.15.43:0/1172673842 wait complete. 2024-09-17T04:35:00.973 INFO:teuthology.orchestra.run.smithi043.stdout:60129542149 2024-09-17T04:35:00.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.975+0000 7f99b759e640 1 -- 172.21.15.43:0/486112176 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9998078b90 msgr2=0x7f999807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.975+0000 7f99b759e640 1 --2- 172.21.15.43:0/486112176 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9998078b90 0x7f999807b0a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f99a80095f0 tx=0x7f99a80046c0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.975+0000 7f99b759e640 1 -- 172.21.15.43:0/486112176 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99b004e600 msgr2=0x7f99b017ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.975+0000 7f99b759e640 1 --2- 172.21.15.43:0/486112176 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99b004e600 0x7f99b017ce10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00e710 tx=0x7f99ac00ebd0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.975+0000 7f99b759e640 1 -- 172.21.15.43:0/486112176 shutdown_connections 2024-09-17T04:35:00.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.975+0000 7f99b759e640 1 --2- 172.21.15.43:0/486112176 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9998078b90 0x7f999807b0a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.975+0000 7f99b759e640 1 --2- 172.21.15.43:0/486112176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99b004f2a0 0x7f99b00d3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.975+0000 7f99b759e640 1 --2- 172.21.15.43:0/486112176 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99b004e600 0x7f99b017ce10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.975+0000 7f99b759e640 1 --2- 172.21.15.43:0/486112176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99b0044dc0 0x7f99b0008290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.976+0000 7f99b759e640 1 -- 172.21.15.43:0/486112176 >> 172.21.15.43:0/486112176 conn(0x7f99b000de50 msgr2=0x7f99b00d5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.976+0000 7f03f606c640 1 -- 172.21.15.43:0/3241288021 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f03d4078c30 msgr2=0x7f03d407b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.976+0000 7f03f606c640 1 --2- 172.21.15.43:0/3241288021 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f03d4078c30 0x7f03d407b140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f03ec001cd0 tx=0x7f03ec0011e0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.976+0000 7f03f606c640 1 -- 172.21.15.43:0/3241288021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03e817caa0 msgr2=0x7f03e817ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.976+0000 7f03f606c640 1 --2- 172.21.15.43:0/3241288021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03e817caa0 0x7f03e817ceb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f03f006c720 tx=0x7f03f0075710 comp rx=0 tx=0).stop 2024-09-17T04:35:00.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.976+0000 7f99b759e640 1 -- 172.21.15.43:0/486112176 shutdown_connections 2024-09-17T04:35:00.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.976+0000 7f99b759e640 1 -- 172.21.15.43:0/486112176 wait complete. 2024-09-17T04:35:00.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.976+0000 7f03f606c640 1 -- 172.21.15.43:0/3241288021 shutdown_connections 2024-09-17T04:35:00.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.976+0000 7f03f606c640 1 --2- 172.21.15.43:0/3241288021 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f03d4078c30 0x7f03d407b140 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f03ec001cd0 tx=0x7f03ec0011e0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.976+0000 7f03f606c640 1 --2- 172.21.15.43:0/3241288021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03e817caa0 0x7f03e817ceb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.976+0000 7f03f606c640 1 --2- 172.21.15.43:0/3241288021 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03e80d2b90 0x7f03e80d66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.976+0000 7f03f606c640 1 --2- 172.21.15.43:0/3241288021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03dc007950 0x7f03e80cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.977+0000 7f03f606c640 1 -- 172.21.15.43:0/3241288021 >> 172.21.15.43:0/3241288021 conn(0x7f03e804fe30 msgr2=0x7f03e8006b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.977+0000 7f03f606c640 1 -- 172.21.15.43:0/3241288021 shutdown_connections 2024-09-17T04:35:00.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.977+0000 7f03f606c640 1 -- 172.21.15.43:0/3241288021 wait complete. 2024-09-17T04:35:00.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476742 for osd.4 2024-09-17T04:35:00.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.984+0000 7f4af6c63640 1 -- 172.21.15.43:0/1979470712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4ae80dc550 con 0x7f4ae804d8e0 2024-09-17T04:35:00.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.985+0000 7f4ae67fc640 1 -- 172.21.15.43:0/1979470712 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4aec083810 con 0x7f4ae804d8e0 2024-09-17T04:35:00.985 INFO:teuthology.orchestra.run.smithi043.stdout:60129542149 2024-09-17T04:35:00.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.987+0000 7f0876dce640 1 -- 172.21.15.43:0/3295130482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0868032a10 con 0x7f0868044cb0 2024-09-17T04:35:00.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.988+0000 7f08667fc640 1 -- 172.21.15.43:0/3295130482 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f086c062430 con 0x7f0868044cb0 2024-09-17T04:35:00.988 INFO:teuthology.orchestra.run.smithi043.stdout:60129542150 2024-09-17T04:35:00.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.989+0000 7f4af6c63640 1 -- 172.21.15.43:0/1979470712 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4ad4078b90 msgr2=0x7f4ad407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.989+0000 7f4af6c63640 1 --2- 172.21.15.43:0/1979470712 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4ad4078b90 0x7f4ad407b0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000b980 tx=0x7f4ae0005ce0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.989+0000 7f4af6c63640 1 -- 172.21.15.43:0/1979470712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ae804d8e0 msgr2=0x7f4ae8051470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.989+0000 7f4af6c63640 1 --2- 172.21.15.43:0/1979470712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ae804d8e0 0x7f4ae8051470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4aec034040 tx=0x7f4aec003960 comp rx=0 tx=0).stop 2024-09-17T04:35:00.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.990+0000 7f4af6c63640 1 -- 172.21.15.43:0/1979470712 shutdown_connections 2024-09-17T04:35:00.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.990+0000 7f4af6c63640 1 --2- 172.21.15.43:0/1979470712 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4ad4078b90 0x7f4ad407b0a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.990+0000 7f4af6c63640 1 --2- 172.21.15.43:0/1979470712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ae80e2b70 0x7f4ae8044260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.990+0000 7f4af6c63640 1 --2- 172.21.15.43:0/1979470712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ae804d8e0 0x7f4ae8051470 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.990+0000 7f4af6c63640 1 --2- 172.21.15.43:0/1979470712 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ae800d2b0 0x7f4ae8169200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.990+0000 7f4af6c63640 1 -- 172.21.15.43:0/1979470712 >> 172.21.15.43:0/1979470712 conn(0x7f4ae800e3b0 msgr2=0x7f4ae804ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476742 for osd.5 2024-09-17T04:35:00.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.990+0000 7f4af6c63640 1 -- 172.21.15.43:0/1979470712 shutdown_connections 2024-09-17T04:35:00.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.990+0000 7f4af6c63640 1 -- 172.21.15.43:0/1979470712 wait complete. 2024-09-17T04:35:00.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.1 2024-09-17T04:35:00.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.991+0000 7f0876dce640 1 -- 172.21.15.43:0/3295130482 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0854078b90 msgr2=0x7f085407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.992+0000 7f0876dce640 1 --2- 172.21.15.43:0/3295130482 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0854078b90 0x7f085407b0a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0860032000 tx=0x7f08600046c0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.992+0000 7f0876dce640 1 -- 172.21.15.43:0/3295130482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0868044cb0 msgr2=0x7f0868161ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:00.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.992+0000 7f0876dce640 1 --2- 172.21.15.43:0/3295130482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0868044cb0 0x7f0868161ec0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f086c00c370 tx=0x7f086c00c830 comp rx=0 tx=0).stop 2024-09-17T04:35:00.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.992+0000 7f0876dce640 1 -- 172.21.15.43:0/3295130482 shutdown_connections 2024-09-17T04:35:00.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.992+0000 7f0876dce640 1 --2- 172.21.15.43:0/3295130482 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0854078b90 0x7f085407b0a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.992+0000 7f0876dce640 1 --2- 172.21.15.43:0/3295130482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08680469d0 0x7f0868160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.992+0000 7f0876dce640 1 --2- 172.21.15.43:0/3295130482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08680d16a0 0x7f0868005c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.992+0000 7f0876dce640 1 --2- 172.21.15.43:0/3295130482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0868044cb0 0x7f0868161ec0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:00.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.992+0000 7f0876dce640 1 -- 172.21.15.43:0/3295130482 >> 172.21.15.43:0/3295130482 conn(0x7f086804fe30 msgr2=0x7f08680ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:00.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.992+0000 7f0876dce640 1 -- 172.21.15.43:0/3295130482 shutdown_connections 2024-09-17T04:35:00.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:00.992+0000 7f0876dce640 1 -- 172.21.15.43:0/3295130482 wait complete. 2024-09-17T04:35:00.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476742 for osd.6 2024-09-17T04:35:00.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476742 for osd.7 2024-09-17T04:35:00.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.3 2024-09-17T04:35:01.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.0 2024-09-17T04:35:01.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.2 2024-09-17T04:35:01.986 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T04:35:01.992 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T04:35:01.994 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T04:35:01.995 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T04:35:01.997 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T04:35:02.000 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T04:35:02.006 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T04:35:02.006 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T04:35:02.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.193+0000 7f797804d640 1 -- 172.21.15.43:0/194555351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79700c3a80 msgr2=0x7f797015c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.193+0000 7f797804d640 1 --2- 172.21.15.43:0/194555351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79700c3a80 0x7f797015c460 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7970072260 tx=0x7f796802aa50 comp rx=0 tx=0).stop 2024-09-17T04:35:02.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.193+0000 7f797804d640 1 -- 172.21.15.43:0/194555351 shutdown_connections 2024-09-17T04:35:02.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.193+0000 7f797804d640 1 --2- 172.21.15.43:0/194555351 >> v2:172.21.15.43:3300/0 conn(0x7f797006ddc0 0x7f79700c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.193+0000 7f797804d640 1 --2- 172.21.15.43:0/194555351 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f797015ede0 0x7f797015f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.193+0000 7f797804d640 1 --2- 172.21.15.43:0/194555351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79700c3a80 0x7f797015c460 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.193+0000 7f797804d640 1 -- 172.21.15.43:0/194555351 >> 172.21.15.43:0/194555351 conn(0x7f7970070540 msgr2=0x7f7970070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:02.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.194+0000 7f797804d640 1 -- 172.21.15.43:0/194555351 shutdown_connections 2024-09-17T04:35:02.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.194+0000 7f797804d640 1 -- 172.21.15.43:0/194555351 wait complete. 2024-09-17T04:35:02.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.197+0000 7f797804d640 1 Processor -- start 2024-09-17T04:35:02.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.198+0000 7f797804d640 1 -- start start 2024-09-17T04:35:02.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.200+0000 7f797804d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f797006ddc0 0x7f79700cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.201+0000 7f797804d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79700c3a80 0x7f797015da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.201+0000 7f7975de9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f797006ddc0 0x7f79700cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.201+0000 7f7975de9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f797006ddc0 0x7f79700cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35398/0 (socket says 172.21.15.43:35398) 2024-09-17T04:35:02.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.201+0000 7f7975de9640 1 -- 172.21.15.43:0/4126427325 learned_addr learned my addr 172.21.15.43:0/4126427325 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:02.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.201+0000 7f797804d640 1 --2- 172.21.15.43:0/4126427325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f797015ede0 0x7f797015df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.201+0000 7f797804d640 1 -- 172.21.15.43:0/4126427325 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f797015b980 con 0x7f797006ddc0 2024-09-17T04:35:02.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.201+0000 7f797804d640 1 -- 172.21.15.43:0/4126427325 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f79700c9280 con 0x7f79700c3a80 2024-09-17T04:35:02.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.202+0000 7f797804d640 1 -- 172.21.15.43:0/4126427325 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f797015bc60 con 0x7f797015ede0 2024-09-17T04:35:02.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.202+0000 7f79755e8640 1 --2- 172.21.15.43:0/4126427325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79700c3a80 0x7f797015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.202+0000 7f79765ea640 1 --2- 172.21.15.43:0/4126427325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f797015ede0 0x7f797015df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.203+0000 7f7975de9640 1 -- 172.21.15.43:0/4126427325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f797015ede0 msgr2=0x7f797015df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.203+0000 7f7975de9640 1 --2- 172.21.15.43:0/4126427325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f797015ede0 0x7f797015df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.203+0000 7f7975de9640 1 -- 172.21.15.43:0/4126427325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79700c3a80 msgr2=0x7f797015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.203+0000 7f7975de9640 1 --2- 172.21.15.43:0/4126427325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79700c3a80 0x7f797015da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.203+0000 7f7975de9640 1 -- 172.21.15.43:0/4126427325 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79701f6b80 con 0x7f797006ddc0 2024-09-17T04:35:02.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.204+0000 7f7975de9640 1 --2- 172.21.15.43:0/4126427325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f797006ddc0 0x7f79700cbf00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7968009d60 tx=0x7f7968003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.204+0000 7f79627fc640 1 -- 172.21.15.43:0/4126427325 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7968036a30 con 0x7f797006ddc0 2024-09-17T04:35:02.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.205+0000 7f79627fc640 1 -- 172.21.15.43:0/4126427325 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7968036bd0 con 0x7f797006ddc0 2024-09-17T04:35:02.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.205+0000 7f79627fc640 1 -- 172.21.15.43:0/4126427325 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7968004000 con 0x7f797006ddc0 2024-09-17T04:35:02.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.205+0000 7f797804d640 1 -- 172.21.15.43:0/4126427325 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79700c4000 con 0x7f797006ddc0 2024-09-17T04:35:02.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.208+0000 7f79627fc640 1 -- 172.21.15.43:0/4126427325 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f79680041a0 con 0x7f797006ddc0 2024-09-17T04:35:02.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.209+0000 7f79627fc640 1 --2- 172.21.15.43:0/4126427325 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7954078c10 0x7f795407b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.209+0000 7f797804d640 1 -- 172.21.15.43:0/4126427325 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79700c45c0 con 0x7f797006ddc0 2024-09-17T04:35:02.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.210+0000 7f79627fc640 1 -- 172.21.15.43:0/4126427325 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7968080360 con 0x7f797006ddc0 2024-09-17T04:35:02.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.210+0000 7f79755e8640 1 --2- 172.21.15.43:0/4126427325 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7954078c10 0x7f795407b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.211+0000 7f797804d640 1 -- 172.21.15.43:0/4126427325 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79700c85d0 con 0x7f797006ddc0 2024-09-17T04:35:02.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.221+0000 7f79627fc640 1 -- 172.21.15.43:0/4126427325 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7968032030 con 0x7f797006ddc0 2024-09-17T04:35:02.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.225+0000 7f79755e8640 1 --2- 172.21.15.43:0/4126427325 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7954078c10 0x7f795407b120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f796c00a4d0 tx=0x7f796c00a460 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.255+0000 7feec0cfc640 1 -- 172.21.15.43:0/1499249199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb4045540 msgr2=0x7feeb4007ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.255+0000 7feec0cfc640 1 --2- 172.21.15.43:0/1499249199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb4045540 0x7feeb4007ae0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7feeb40505d0 tx=0x7feea802a560 comp rx=0 tx=0).stop 2024-09-17T04:35:02.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.256+0000 7feec0cfc640 1 -- 172.21.15.43:0/1499249199 shutdown_connections 2024-09-17T04:35:02.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.256+0000 7feec0cfc640 1 --2- 172.21.15.43:0/1499249199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb4045540 0x7feeb4007ae0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.256+0000 7feec0cfc640 1 --2- 172.21.15.43:0/1499249199 >> v2:172.21.15.62:3300/0 conn(0x7feeb404c9b0 0x7feeb40d5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.256+0000 7feec0cfc640 1 -- 172.21.15.43:0/1499249199 >> 172.21.15.43:0/1499249199 conn(0x7feeb40506c0 msgr2=0x7feeb4050ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:02.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.256+0000 7feec0cfc640 1 -- 172.21.15.43:0/1499249199 shutdown_connections 2024-09-17T04:35:02.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.256+0000 7feec0cfc640 1 -- 172.21.15.43:0/1499249199 wait complete. 2024-09-17T04:35:02.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.259+0000 7feec0cfc640 1 Processor -- start 2024-09-17T04:35:02.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.259+0000 7feec0cfc640 1 -- start start 2024-09-17T04:35:02.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.261+0000 7feec0cfc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feeb4005fe0 0x7feeb4175560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.261+0000 7feec0cfc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb4045540 0x7feeb40ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.261+0000 7feec0cfc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feeb404c9b0 0x7feeb40d7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.261+0000 7feec0cfc640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feeb4034530 con 0x7feeb4045540 2024-09-17T04:35:02.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.261+0000 7feec0cfc640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7feeb4008020 con 0x7feeb404c9b0 2024-09-17T04:35:02.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.261+0000 7feec0cfc640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7feeb4045950 con 0x7feeb4005fe0 2024-09-17T04:35:02.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.261+0000 7feebb7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feeb4005fe0 0x7feeb4175560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.261+0000 7feebb7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feeb4005fe0 0x7feeb4175560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:60180/0 (socket says 172.21.15.43:60180) 2024-09-17T04:35:02.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.261+0000 7feebb7fe640 1 -- 172.21.15.43:0/2755251326 learned_addr learned my addr 172.21.15.43:0/2755251326 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:02.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.261+0000 7feebaffd640 1 --2- 172.21.15.43:0/2755251326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb4045540 0x7feeb40ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.262+0000 7feebbfff640 1 --2- 172.21.15.43:0/2755251326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feeb404c9b0 0x7feeb40d7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.262+0000 7feebaffd640 1 -- 172.21.15.43:0/2755251326 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feeb4005fe0 msgr2=0x7feeb4175560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.262+0000 7feebaffd640 1 --2- 172.21.15.43:0/2755251326 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feeb4005fe0 0x7feeb4175560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.262+0000 7feebaffd640 1 -- 172.21.15.43:0/2755251326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feeb404c9b0 msgr2=0x7feeb40d7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.262+0000 7feebaffd640 1 --2- 172.21.15.43:0/2755251326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feeb404c9b0 0x7feeb40d7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.262+0000 7feebaffd640 1 -- 172.21.15.43:0/2755251326 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb4175aa0 con 0x7feeb4045540 2024-09-17T04:35:02.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.263+0000 7feebaffd640 1 --2- 172.21.15.43:0/2755251326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb4045540 0x7feeb40ca460 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feea8031000 tx=0x7feea80045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.263+0000 7f41faffd640 1 -- 172.21.15.43:0/3342090244 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc0ada50 con 0x7f41f404b370 2024-09-17T04:35:02.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.263+0000 7f420108a640 1 -- 172.21.15.43:0/3342090244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41f404b370 msgr2=0x7f41f404b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.263+0000 7f420108a640 1 --2- 172.21.15.43:0/3342090244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41f404b370 0x7f41f404b780 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f41fc077420 tx=0x7f41fc0a7940 comp rx=0 tx=0).stop 2024-09-17T04:35:02.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.264+0000 7fcf87b4a640 1 -- 172.21.15.43:0/56729766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf8006e8a0 msgr2=0x7fcf80070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.264+0000 7fcf87b4a640 1 --2- 172.21.15.43:0/56729766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf8006e8a0 0x7fcf80070100 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf800cbab0 tx=0x7fcf7002a5d0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.263+0000 7feea7fff640 1 -- 172.21.15.43:0/2755251326 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8031600 con 0x7feeb4045540 2024-09-17T04:35:02.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.263+0000 7feec0cfc640 1 -- 172.21.15.43:0/2755251326 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb40ca9a0 con 0x7feeb4045540 2024-09-17T04:35:02.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.263+0000 7feec0cfc640 1 -- 172.21.15.43:0/2755251326 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb40334d0 con 0x7feeb4045540 2024-09-17T04:35:02.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.264+0000 7f1d92827640 1 -- 172.21.15.43:0/3729051939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c074bf0 msgr2=0x7f1d8c075000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.264+0000 7f1d92827640 1 --2- 172.21.15.43:0/3729051939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c074bf0 0x7f1d8c075000 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c070520 tx=0x7f1d8002c330 comp rx=0 tx=0).stop 2024-09-17T04:35:02.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.264+0000 7f1d92827640 1 -- 172.21.15.43:0/3729051939 shutdown_connections 2024-09-17T04:35:02.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.264+0000 7f1d92827640 1 --2- 172.21.15.43:0/3729051939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c074bf0 0x7f1d8c075000 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.264+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/2372827170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7eb40c7b10 msgr2=0x7f7eb4150ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.264+0000 7f7eb8bd6640 1 --2- 172.21.15.43:0/2372827170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7eb40c7b10 0x7f7eb4150ef0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40ce360 tx=0x7f7eac02ab50 comp rx=0 tx=0).stop 2024-09-17T04:35:02.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.264+0000 7f1d92827640 1 --2- 172.21.15.43:0/3729051939 >> v2:172.21.15.43:3300/0 conn(0x7f1d8c0ca610 0x7f1d8c152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.264+0000 7f1d92827640 1 -- 172.21.15.43:0/3729051939 >> 172.21.15.43:0/3729051939 conn(0x7f1d8c0c9af0 msgr2=0x7f1d8c0c9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:02.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7fcf87b4a640 1 -- 172.21.15.43:0/56729766 shutdown_connections 2024-09-17T04:35:02.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7fcf87b4a640 1 --2- 172.21.15.43:0/56729766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf8006e8a0 0x7fcf80070100 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7fcf87b4a640 1 --2- 172.21.15.43:0/56729766 >> v2:172.21.15.62:3300/0 conn(0x7fcf800c2f40 0x7fcf801525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7fcf87b4a640 1 -- 172.21.15.43:0/56729766 >> 172.21.15.43:0/56729766 conn(0x7fcf800738e0 msgr2=0x7fcf80073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:02.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/2372827170 shutdown_connections 2024-09-17T04:35:02.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f7eb8bd6640 1 --2- 172.21.15.43:0/2372827170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7eb40c7b10 0x7f7eb4150ef0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f7eb8bd6640 1 --2- 172.21.15.43:0/2372827170 >> v2:172.21.15.62:3300/0 conn(0x7f7eb40741e0 0x7f7eb415c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/2372827170 >> 172.21.15.43:0/2372827170 conn(0x7f7eb40cd290 msgr2=0x7f7eb40cd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:02.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/2372827170 shutdown_connections 2024-09-17T04:35:02.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7fcf87b4a640 1 -- 172.21.15.43:0/56729766 shutdown_connections 2024-09-17T04:35:02.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7fcf87b4a640 1 -- 172.21.15.43:0/56729766 wait complete. 2024-09-17T04:35:02.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7feea7fff640 1 -- 172.21.15.43:0/2755251326 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feea8031ba0 con 0x7feeb4045540 2024-09-17T04:35:02.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7feec0cfc640 1 -- 172.21.15.43:0/2755251326 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb404bc00 con 0x7feeb4045540 2024-09-17T04:35:02.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7feea7fff640 1 -- 172.21.15.43:0/2755251326 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea80330d0 con 0x7feeb4045540 2024-09-17T04:35:02.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f3830970640 1 -- 172.21.15.43:0/1188111129 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38240de5e0 msgr2=0x7f38240de9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f3830970640 1 --2- 172.21.15.43:0/1188111129 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38240de5e0 0x7f38240de9f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f382c052860 tx=0x7f382c0a7990 comp rx=0 tx=0).stop 2024-09-17T04:35:02.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f3830970640 1 -- 172.21.15.43:0/1188111129 shutdown_connections 2024-09-17T04:35:02.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f3830970640 1 --2- 172.21.15.43:0/1188111129 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38240de5e0 0x7f38240de9f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f3830970640 1 -- 172.21.15.43:0/1188111129 >> 172.21.15.43:0/1188111129 conn(0x7f38240506c0 msgr2=0x7f3824050ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:02.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f3830970640 1 -- 172.21.15.43:0/1188111129 shutdown_connections 2024-09-17T04:35:02.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f3830970640 1 -- 172.21.15.43:0/1188111129 wait complete. 2024-09-17T04:35:02.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f1d92827640 1 -- 172.21.15.43:0/3729051939 shutdown_connections 2024-09-17T04:35:02.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f1d92827640 1 -- 172.21.15.43:0/3729051939 wait complete. 2024-09-17T04:35:02.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f420108a640 1 -- 172.21.15.43:0/3342090244 shutdown_connections 2024-09-17T04:35:02.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f420108a640 1 --2- 172.21.15.43:0/3342090244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41f404b370 0x7f41f404b780 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f420108a640 1 --2- 172.21.15.43:0/3342090244 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41f40df620 0x7f41f40454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f420108a640 1 -- 172.21.15.43:0/3342090244 >> 172.21.15.43:0/3342090244 conn(0x7f41f404fe30 msgr2=0x7f41f4050240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:02.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.265+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/2372827170 wait complete. 2024-09-17T04:35:02.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.266+0000 7f420108a640 1 -- 172.21.15.43:0/3342090244 shutdown_connections 2024-09-17T04:35:02.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.266+0000 7f420108a640 1 -- 172.21.15.43:0/3342090244 wait complete. 2024-09-17T04:35:02.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.268+0000 7fcf87b4a640 1 Processor -- start 2024-09-17T04:35:02.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.268+0000 7fcf87b4a640 1 -- start start 2024-09-17T04:35:02.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.268+0000 7f7eb8bd6640 1 Processor -- start 2024-09-17T04:35:02.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.268+0000 7f1d92827640 1 Processor -- start 2024-09-17T04:35:02.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.268+0000 7f7eb8bd6640 1 -- start start 2024-09-17T04:35:02.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.268+0000 7f1d92827640 1 -- start start 2024-09-17T04:35:02.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.269+0000 7f3830970640 1 Processor -- start 2024-09-17T04:35:02.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.269+0000 7f3830970640 1 -- start start 2024-09-17T04:35:02.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.269+0000 7f420108a640 1 Processor -- start 2024-09-17T04:35:02.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.270+0000 7fcf87b4a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf8006e8a0 0x7fcf801490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.269+0000 7feea7fff640 1 -- 172.21.15.43:0/2755251326 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feea8033270 con 0x7feeb4045540 2024-09-17T04:35:02.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.270+0000 7feea7fff640 1 --2- 172.21.15.43:0/2755251326 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7feea0078b90 0x7feea007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.270+0000 7fcf87b4a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf80070640 0x7fcf801f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.270+0000 7feea7fff640 1 -- 172.21.15.43:0/2755251326 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7feea80bbe40 con 0x7feeb4045540 2024-09-17T04:35:02.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.270+0000 7fcf87b4a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf800c2f40 0x7fcf801f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.270+0000 7fcf87b4a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcf80070c00 con 0x7fcf80070640 2024-09-17T04:35:02.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.270+0000 7fcf87b4a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fcf800c3dd0 con 0x7fcf8006e8a0 2024-09-17T04:35:02.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.270+0000 7fcf87b4a640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fcf800b41e0 con 0x7fcf800c2f40 2024-09-17T04:35:02.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.270+0000 7fcf850e5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf80070640 0x7fcf801f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.270+0000 7fcf858e6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf8006e8a0 0x7fcf801490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.270+0000 7fcf858e6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf8006e8a0 0x7fcf801490b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:52092/0 (socket says 172.21.15.43:52092) 2024-09-17T04:35:02.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.270+0000 7fcf858e6640 1 -- 172.21.15.43:0/3350988504 learned_addr learned my addr 172.21.15.43:0/3350988504 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:02.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.270+0000 7f420108a640 1 -- start start 2024-09-17T04:35:02.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.271+0000 7fcf860e7640 1 --2- 172.21.15.43:0/3350988504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf800c2f40 0x7fcf801f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.271+0000 7f1d92827640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d8c072a80 0x7f1d8c1ed780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.271+0000 7fcf850e5640 1 -- 172.21.15.43:0/3350988504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf800c2f40 msgr2=0x7fcf801f1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.271+0000 7fcf850e5640 1 --2- 172.21.15.43:0/3350988504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf800c2f40 0x7fcf801f1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.271+0000 7fcf850e5640 1 -- 172.21.15.43:0/3350988504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf8006e8a0 msgr2=0x7fcf801490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.271+0000 7fcf850e5640 1 --2- 172.21.15.43:0/3350988504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf8006e8a0 0x7fcf801490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.271+0000 7fcf850e5640 1 -- 172.21.15.43:0/3350988504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf801495f0 con 0x7fcf80070640 2024-09-17T04:35:02.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.271+0000 7feebb7fe640 1 --2- 172.21.15.43:0/2755251326 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7feea0078b90 0x7feea007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.271+0000 7f3830970640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f382404c9b0 0x7f3824174620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.271+0000 7f1d92827640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d8c074bf0 0x7f1d8c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.271+0000 7fcf850e5640 1 --2- 172.21.15.43:0/3350988504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf80070640 0x7fcf801f1920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcf70031000 tx=0x7fcf70003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.271+0000 7f3830970640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38240d5240 0x7f38240caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.271+0000 7f1d8bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d8c072a80 0x7f1d8c1ed780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.271+0000 7f1d92827640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c0ca610 0x7f1d8c148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.271+0000 7f1d8bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d8c072a80 0x7f1d8c1ed780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35462/0 (socket says 172.21.15.43:35462) 2024-09-17T04:35:02.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.271+0000 7f1d8b7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d8c074bf0 0x7f1d8c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f382ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f382404c9b0 0x7f3824174620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f382ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f382404c9b0 0x7f3824174620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:52096/0 (socket says 172.21.15.43:52096) 2024-09-17T04:35:02.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f382ad9d640 1 -- 172.21.15.43:0/1403430123 learned_addr learned my addr 172.21.15.43:0/1403430123 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:02.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f382a59c640 1 --2- 172.21.15.43:0/1403430123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38240d5240 0x7f38240caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f3830970640 1 --2- 172.21.15.43:0/1403430123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38240de5e0 0x7f38240d2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f1d8b7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d8c074bf0 0x7f1d8c0c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:60198/0 (socket says 172.21.15.43:60198) 2024-09-17T04:35:02.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f1d8bfff640 1 -- 172.21.15.43:0/1729295174 learned_addr learned my addr 172.21.15.43:0/1729295174 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:02.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f1d90dc4640 1 --2- 172.21.15.43:0/1729295174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c0ca610 0x7f1d8c148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f7eb8bd6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7eb4070b70 0x7f7eb414d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f7eb8bd6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7eb40741e0 0x7f7eb415d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f1d92827640 1 -- 172.21.15.43:0/1729295174 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8c06f320 con 0x7f1d8c072a80 2024-09-17T04:35:02.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f1d92827640 1 -- 172.21.15.43:0/1729295174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8c1590d0 con 0x7f1d8c0ca610 2024-09-17T04:35:02.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f1d92827640 1 -- 172.21.15.43:0/1729295174 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1d8c0735f0 con 0x7f1d8c074bf0 2024-09-17T04:35:02.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f1d8bfff640 1 -- 172.21.15.43:0/1729295174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d8c074bf0 msgr2=0x7f1d8c0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f1d8bfff640 1 --2- 172.21.15.43:0/1729295174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d8c074bf0 0x7f1d8c0c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f1d8bfff640 1 -- 172.21.15.43:0/1729295174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c0ca610 msgr2=0x7f1d8c148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f1d8bfff640 1 --2- 172.21.15.43:0/1729295174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c0ca610 0x7f1d8c148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f3830970640 1 -- 172.21.15.43:0/1403430123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f38240d5650 con 0x7f38240d5240 2024-09-17T04:35:02.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f1d8bfff640 1 -- 172.21.15.43:0/1729295174 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d8c0c3ce0 con 0x7f1d8c072a80 2024-09-17T04:35:02.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f1d90dc4640 1 --2- 172.21.15.43:0/1729295174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c0ca610 0x7f1d8c148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:35:02.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f382b59e640 1 --2- 172.21.15.43:0/1403430123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38240de5e0 0x7f38240d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f7eb8bd6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7eb40c7b10 0x7f7eb4154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f420108a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41f4044d20 0x7f41f4048010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f420108a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41f404b370 0x7f41f416a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f420108a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41f40df620 0x7f41f4169b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f420108a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f41f4005dd0 con 0x7f41f40df620 2024-09-17T04:35:02.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f420108a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f41f4005c50 con 0x7f41f4044d20 2024-09-17T04:35:02.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f420108a640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f41f4005f50 con 0x7f41f404b370 2024-09-17T04:35:02.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f3830970640 1 -- 172.21.15.43:0/1403430123 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f382404c510 con 0x7f382404c9b0 2024-09-17T04:35:02.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f3830970640 1 -- 172.21.15.43:0/1403430123 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3824034530 con 0x7f38240de5e0 2024-09-17T04:35:02.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f4200889640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41f40df620 0x7f41f4169b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f4200889640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41f40df620 0x7f41f4169b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35482/0 (socket says 172.21.15.43:35482) 2024-09-17T04:35:02.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f4200889640 1 -- 172.21.15.43:0/142687400 learned_addr learned my addr 172.21.15.43:0/142687400 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:02.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f41fb7fe640 1 --2- 172.21.15.43:0/142687400 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41f404b370 0x7f41f416a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f1d8bfff640 1 --2- 172.21.15.43:0/1729295174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d8c072a80 0x7f1d8c1ed780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400c0f0 tx=0x7f1d8400c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.272+0000 7f7eabfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7eb40741e0 0x7f7eb415d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f7eabfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7eb40741e0 0x7f7eb415d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35494/0 (socket says 172.21.15.43:35494) 2024-09-17T04:35:02.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f7eabfff640 1 -- 172.21.15.43:0/3747199328 learned_addr learned my addr 172.21.15.43:0/3747199328 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:02.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f7eb37fe640 1 --2- 172.21.15.43:0/3747199328 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7eb4070b70 0x7f7eb414d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f382ad9d640 1 -- 172.21.15.43:0/1403430123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38240de5e0 msgr2=0x7f38240d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f7eb3fff640 1 --2- 172.21.15.43:0/3747199328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7eb40c7b10 0x7f7eb4154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f382ad9d640 1 --2- 172.21.15.43:0/1403430123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38240de5e0 0x7f38240d2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f382ad9d640 1 -- 172.21.15.43:0/1403430123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38240d5240 msgr2=0x7f38240caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f382ad9d640 1 --2- 172.21.15.43:0/1403430123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38240d5240 0x7f38240caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f382ad9d640 1 -- 172.21.15.43:0/1403430123 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38240cff40 con 0x7f382404c9b0 2024-09-17T04:35:02.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/3747199328 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb415b860 con 0x7f7eb40741e0 2024-09-17T04:35:02.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/3747199328 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb415bbb0 con 0x7f7eb40c7b10 2024-09-17T04:35:02.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f382a59c640 1 --2- 172.21.15.43:0/1403430123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38240d5240 0x7f38240caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:35:02.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/3747199328 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb4072dc0 con 0x7f7eb4070b70 2024-09-17T04:35:02.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f41fbfff640 1 --2- 172.21.15.43:0/142687400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41f4044d20 0x7f41f4048010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f4200889640 1 -- 172.21.15.43:0/142687400 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41f404b370 msgr2=0x7f41f416a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f4200889640 1 --2- 172.21.15.43:0/142687400 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41f404b370 0x7f41f416a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f4200889640 1 -- 172.21.15.43:0/142687400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41f4044d20 msgr2=0x7f41f4048010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f4200889640 1 --2- 172.21.15.43:0/142687400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41f4044d20 0x7f41f4048010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f4200889640 1 -- 172.21.15.43:0/142687400 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f4048550 con 0x7f41f40df620 2024-09-17T04:35:02.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f41fb7fe640 1 --2- 172.21.15.43:0/142687400 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41f404b370 0x7f41f416a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:35:02.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f382ad9d640 1 --2- 172.21.15.43:0/1403430123 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f382404c9b0 0x7f3824174620 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f381c00c430 tx=0x7f381c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.273+0000 7f4200889640 1 --2- 172.21.15.43:0/142687400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41f40df620 0x7f41f4169b40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f41fc06a550 tx=0x7f41fc0b55e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.274+0000 7f7eabfff640 1 -- 172.21.15.43:0/3747199328 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7eb4070b70 msgr2=0x7f7eb414d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.274+0000 7f7eabfff640 1 --2- 172.21.15.43:0/3747199328 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7eb4070b70 0x7f7eb414d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.274+0000 7f7eabfff640 1 -- 172.21.15.43:0/3747199328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7eb40c7b10 msgr2=0x7f7eb4154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.274+0000 7f38137fe640 1 -- 172.21.15.43:0/1403430123 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c011790 con 0x7f382404c9b0 2024-09-17T04:35:02.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.274+0000 7f7eabfff640 1 --2- 172.21.15.43:0/3747199328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7eb40c7b10 0x7f7eb4154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.274+0000 7f7eabfff640 1 -- 172.21.15.43:0/3747199328 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb414d690 con 0x7f7eb40741e0 2024-09-17T04:35:02.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.274+0000 7feebb7fe640 1 --2- 172.21.15.43:0/2755251326 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7feea0078b90 0x7feea007b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feebc051d10 tx=0x7feebc070040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.274+0000 7f7eabfff640 1 --2- 172.21.15.43:0/3747199328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7eb40741e0 0x7f7eb415d150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00c400 tx=0x7f7e9c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.274+0000 7f3830970640 1 -- 172.21.15.43:0/1403430123 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38240d0220 con 0x7f382404c9b0 2024-09-17T04:35:02.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.274+0000 7f3830970640 1 -- 172.21.15.43:0/1403430123 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38240cf7a0 con 0x7f382404c9b0 2024-09-17T04:35:02.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.274+0000 7f38137fe640 1 -- 172.21.15.43:0/1403430123 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f381c017070 con 0x7f382404c9b0 2024-09-17T04:35:02.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.274+0000 7f38137fe640 1 -- 172.21.15.43:0/1403430123 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c011ce0 con 0x7f382404c9b0 2024-09-17T04:35:02.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.274+0000 7fa837fff640 1 -- 172.21.15.43:0/2689999495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa83004c5b0 msgr2=0x7fa8300dac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.274+0000 7fa837fff640 1 --2- 172.21.15.43:0/2689999495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa83004c5b0 0x7fa8300dac50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa82800dbc0 tx=0x7fa82802e4b0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.275+0000 7fa837fff640 1 -- 172.21.15.43:0/2689999495 shutdown_connections 2024-09-17T04:35:02.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.275+0000 7fa837fff640 1 --2- 172.21.15.43:0/2689999495 >> v2:172.21.15.62:3300/0 conn(0x7fa830045c00 0x7fa830045100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.275+0000 7fa837fff640 1 --2- 172.21.15.43:0/2689999495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa83004c5b0 0x7fa8300dac50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.275+0000 7fa837fff640 1 -- 172.21.15.43:0/2689999495 >> 172.21.15.43:0/2689999495 conn(0x7fa830050280 msgr2=0x7fa830050690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:02.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.276+0000 7f3830970640 1 -- 172.21.15.43:0/1403430123 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f380c005290 con 0x7f382404c9b0 2024-09-17T04:35:02.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.276+0000 7fa837fff640 1 -- 172.21.15.43:0/2689999495 shutdown_connections 2024-09-17T04:35:02.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.276+0000 7fa837fff640 1 -- 172.21.15.43:0/2689999495 wait complete. 2024-09-17T04:35:02.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.276+0000 7fcf767fc640 1 -- 172.21.15.43:0/3350988504 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7003e030 con 0x7fcf80070640 2024-09-17T04:35:02.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.276+0000 7feea7fff640 1 -- 172.21.15.43:0/2755251326 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feea803f030 con 0x7feeb4045540 2024-09-17T04:35:02.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.276+0000 7f7eb0ff9640 1 -- 172.21.15.43:0/3747199328 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c017070 con 0x7f7eb40741e0 2024-09-17T04:35:02.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.277+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/3747199328 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb415d690 con 0x7f7eb40741e0 2024-09-17T04:35:02.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.277+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/3747199328 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb4157050 con 0x7f7eb40741e0 2024-09-17T04:35:02.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.276+0000 7fcf87b4a640 1 -- 172.21.15.43:0/3350988504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf80153340 con 0x7fcf80070640 2024-09-17T04:35:02.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.276+0000 7fcf87b4a640 1 -- 172.21.15.43:0/3350988504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf800c9190 con 0x7fcf80070640 2024-09-17T04:35:02.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.277+0000 7fcf767fc640 1 -- 172.21.15.43:0/3350988504 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf70003c20 con 0x7fcf80070640 2024-09-17T04:35:02.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.277+0000 7f38137fe640 1 -- 172.21.15.43:0/1403430123 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f381c01c460 con 0x7f382404c9b0 2024-09-17T04:35:02.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.276+0000 7f1d88ff9640 1 -- 172.21.15.43:0/1729295174 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d840090d0 con 0x7f1d8c072a80 2024-09-17T04:35:02.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.276+0000 7f1d92827640 1 -- 172.21.15.43:0/1729295174 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d8c14a320 con 0x7f1d8c072a80 2024-09-17T04:35:02.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.277+0000 7f1d92827640 1 -- 172.21.15.43:0/1729295174 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d8c1f10f0 con 0x7f1d8c072a80 2024-09-17T04:35:02.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.277+0000 7f41f8ff9640 1 -- 172.21.15.43:0/142687400 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc0b1050 con 0x7f41f40df620 2024-09-17T04:35:02.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.277+0000 7fcf767fc640 1 -- 172.21.15.43:0/3350988504 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70048060 con 0x7fcf80070640 2024-09-17T04:35:02.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.277+0000 7f1d88ff9640 1 -- 172.21.15.43:0/1729295174 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d84009be0 con 0x7f1d8c072a80 2024-09-17T04:35:02.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.277+0000 7f1d88ff9640 1 -- 172.21.15.43:0/1729295174 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d840039a0 con 0x7f1d8c072a80 2024-09-17T04:35:02.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.277+0000 7f38137fe640 1 --2- 172.21.15.43:0/1403430123 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f3818078c60 0x7f381807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.277+0000 7f41f8ff9640 1 -- 172.21.15.43:0/142687400 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41fc0ba070 con 0x7f41f40df620 2024-09-17T04:35:02.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.278+0000 7f41f8ff9640 1 -- 172.21.15.43:0/142687400 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc0b6420 con 0x7f41f40df620 2024-09-17T04:35:02.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.278+0000 7f382a59c640 1 --2- 172.21.15.43:0/1403430123 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f3818078c60 0x7f381807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.278+0000 7f38137fe640 1 -- 172.21.15.43:0/1403430123 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f381c09a890 con 0x7f382404c9b0 2024-09-17T04:35:02.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.278+0000 7f7eb0ff9640 1 -- 172.21.15.43:0/3747199328 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e9c0052d0 con 0x7f7eb40741e0 2024-09-17T04:35:02.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.278+0000 7f7eb0ff9640 1 -- 172.21.15.43:0/3747199328 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c021060 con 0x7f7eb40741e0 2024-09-17T04:35:02.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.278+0000 7f382a59c640 1 --2- 172.21.15.43:0/1403430123 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f3818078c60 0x7f381807b170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f38240d2e90 tx=0x7f3820009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.279+0000 7f420108a640 1 -- 172.21.15.43:0/142687400 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f417aa50 con 0x7f41f40df620 2024-09-17T04:35:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.279+0000 7fa837fff640 1 Processor -- start 2024-09-17T04:35:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.279+0000 7fa837fff640 1 -- start start 2024-09-17T04:35:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.279+0000 7f420108a640 1 -- 172.21.15.43:0/142687400 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f4049b40 con 0x7f41f40df620 2024-09-17T04:35:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.280+0000 7fcf87b4a640 1 -- 172.21.15.43:0/3350988504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf68005290 con 0x7fcf80070640 2024-09-17T04:35:02.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.281+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/3747199328 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e98005290 con 0x7f7eb40741e0 2024-09-17T04:35:02.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.280+0000 7f420108a640 1 -- 172.21.15.43:0/142687400 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f4032800 con 0x7f41f40df620 2024-09-17T04:35:02.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.280+0000 7f1d92827640 1 -- 172.21.15.43:0/1729295174 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d6c005290 con 0x7f1d8c072a80 2024-09-17T04:35:02.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.281+0000 7fcf767fc640 1 -- 172.21.15.43:0/3350988504 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcf70041030 con 0x7fcf80070640 2024-09-17T04:35:02.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.281+0000 7f1d88ff9640 1 -- 172.21.15.43:0/1729295174 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1d8401b020 con 0x7f1d8c072a80 2024-09-17T04:35:02.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.281+0000 7fa837fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa830045c00 0x7fa8300d2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.281+0000 7fa837fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa83004c5b0 0x7fa8300ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.281+0000 7fa837fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8300d5070 0x7fa8300d0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.282+0000 7fa837fff640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa8300dbb80 con 0x7fa83004c5b0 2024-09-17T04:35:02.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.282+0000 7fa837fff640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa8300db8a0 con 0x7fa830045c00 2024-09-17T04:35:02.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.282+0000 7fa837fff640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa8300461f0 con 0x7fa8300d5070 2024-09-17T04:35:02.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.282+0000 7fa8367fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa83004c5b0 0x7fa8300ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.282+0000 7fa8367fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa83004c5b0 0x7fa8300ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35504/0 (socket says 172.21.15.43:35504) 2024-09-17T04:35:02.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.282+0000 7fa8367fc640 1 -- 172.21.15.43:0/1267701990 learned_addr learned my addr 172.21.15.43:0/1267701990 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:02.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.282+0000 7fa836ffd640 1 --2- 172.21.15.43:0/1267701990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa830045c00 0x7fa8300d2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.282+0000 7fa8367fc640 1 -- 172.21.15.43:0/1267701990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8300d5070 msgr2=0x7fa8300d0200 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T04:35:02.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.282+0000 7fa8367fc640 1 --2- 172.21.15.43:0/1267701990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8300d5070 0x7fa8300d0200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.282+0000 7fa8367fc640 1 -- 172.21.15.43:0/1267701990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa830045c00 msgr2=0x7fa8300d2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.282+0000 7fa8367fc640 1 --2- 172.21.15.43:0/1267701990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa830045c00 0x7fa8300d2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.282+0000 7fa8367fc640 1 -- 172.21.15.43:0/1267701990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8300d31d0 con 0x7fa83004c5b0 2024-09-17T04:35:02.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.282+0000 7fa8367fc640 1 --2- 172.21.15.43:0/1267701990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa83004c5b0 0x7fa8300ce190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00c4b0 tx=0x7fa82c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.282+0000 7f38137fe640 1 -- 172.21.15.43:0/1403430123 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f381c062dd0 con 0x7f382404c9b0 2024-09-17T04:35:02.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.283+0000 7fcf767fc640 1 --2- 172.21.15.43:0/3350988504 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fcf64078b90 0x7fcf6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.283+0000 7f1d88ff9640 1 --2- 172.21.15.43:0/1729295174 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1d70078bc0 0x7f1d7007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.283+0000 7f1d88ff9640 1 -- 172.21.15.43:0/1729295174 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1d8409ad20 con 0x7f1d8c072a80 2024-09-17T04:35:02.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.283+0000 7fcf767fc640 1 -- 172.21.15.43:0/3350988504 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcf700bb300 con 0x7fcf80070640 2024-09-17T04:35:02.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.283+0000 7f1d8b7fe640 1 --2- 172.21.15.43:0/1729295174 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1d70078bc0 0x7f1d7007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.283+0000 7f7eb0ff9640 1 -- 172.21.15.43:0/3747199328 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7e9c01a070 con 0x7f7eb40741e0 2024-09-17T04:35:02.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.284+0000 7fcf858e6640 1 --2- 172.21.15.43:0/3350988504 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fcf64078b90 0x7fcf6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.284+0000 7f41f8ff9640 1 -- 172.21.15.43:0/142687400 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f41fc0c5060 con 0x7f41f40df620 2024-09-17T04:35:02.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.284+0000 7f7eb0ff9640 1 --2- 172.21.15.43:0/3747199328 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7e94078d90 0x7f7e9407b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.284+0000 7f7eb0ff9640 1 -- 172.21.15.43:0/3747199328 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7e9c098170 con 0x7f7eb40741e0 2024-09-17T04:35:02.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.284+0000 7f7eb37fe640 1 --2- 172.21.15.43:0/3747199328 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7e94078d90 0x7f7e9407b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.284+0000 7f1d8b7fe640 1 --2- 172.21.15.43:0/1729295174 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1d70078bc0 0x7f1d7007b0d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c1f0d40 tx=0x7f1d78007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.284+0000 7f41f8ff9640 1 --2- 172.21.15.43:0/142687400 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f41e0078bc0 0x7f41e007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.284+0000 7fcf858e6640 1 --2- 172.21.15.43:0/3350988504 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fcf64078b90 0x7fcf6407b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009f30 tx=0x7fcf78009680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.285+0000 7f41f8ff9640 1 -- 172.21.15.43:0/142687400 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f41fc1383e0 con 0x7f41f40df620 2024-09-17T04:35:02.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.285+0000 7f41fbfff640 1 --2- 172.21.15.43:0/142687400 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f41e0078bc0 0x7f41e007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.285+0000 7f7eb37fe640 1 --2- 172.21.15.43:0/3747199328 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7e94078d90 0x7f7e9407b2a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ea400a490 tx=0x7f7ea400a420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.285+0000 7f41fbfff640 1 --2- 172.21.15.43:0/142687400 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f41e0078bc0 0x7f41e007b0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f41e8006fd0 tx=0x7f41e8009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.288+0000 7fa81f7fe640 1 -- 172.21.15.43:0/1267701990 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c016020 con 0x7fa83004c5b0 2024-09-17T04:35:02.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.288+0000 7fcf767fc640 1 -- 172.21.15.43:0/3350988504 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcf700830e0 con 0x7fcf80070640 2024-09-17T04:35:02.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.288+0000 7fa837fff640 1 -- 172.21.15.43:0/1267701990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8300d46a0 con 0x7fa83004c5b0 2024-09-17T04:35:02.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.289+0000 7fa837fff640 1 -- 172.21.15.43:0/1267701990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8300d3e20 con 0x7fa83004c5b0 2024-09-17T04:35:02.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.290+0000 7fa837fff640 1 -- 172.21.15.43:0/1267701990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa830004a70 con 0x7fa83004c5b0 2024-09-17T04:35:02.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.297+0000 7f1d88ff9640 1 -- 172.21.15.43:0/1729295174 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1d84010040 con 0x7f1d8c072a80 2024-09-17T04:35:02.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.306+0000 7f41f8ff9640 1 -- 172.21.15.43:0/142687400 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f41fc100250 con 0x7f41f40df620 2024-09-17T04:35:02.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.316+0000 7f7eb0ff9640 1 -- 172.21.15.43:0/3747199328 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7eb414d690 con 0x7f7eb40741e0 2024-09-17T04:35:02.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.317+0000 7fa81f7fe640 1 -- 172.21.15.43:0/1267701990 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa82c012830 con 0x7fa83004c5b0 2024-09-17T04:35:02.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.317+0000 7fa81f7fe640 1 -- 172.21.15.43:0/1267701990 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c012c20 con 0x7fa83004c5b0 2024-09-17T04:35:02.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.327+0000 7fa81f7fe640 1 -- 172.21.15.43:0/1267701990 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa82c019020 con 0x7fa83004c5b0 2024-09-17T04:35:02.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.327+0000 7fa81f7fe640 1 --2- 172.21.15.43:0/1267701990 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fa824078b90 0x7fa82407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.328+0000 7fa836ffd640 1 --2- 172.21.15.43:0/1267701990 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fa824078b90 0x7fa82407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.328+0000 7fa81f7fe640 1 -- 172.21.15.43:0/1267701990 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa82c09b140 con 0x7fa83004c5b0 2024-09-17T04:35:02.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.328+0000 7fa81f7fe640 1 -- 172.21.15.43:0/1267701990 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa82c020020 con 0x7fa83004c5b0 2024-09-17T04:35:02.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.329+0000 7fa836ffd640 1 --2- 172.21.15.43:0/1267701990 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fa824078b90 0x7fa82407b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa828037000 tx=0x7fa828004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.623+0000 7f797804d640 1 -- 172.21.15.43:0/4126427325 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f79700c80b0 con 0x7f797006ddc0 2024-09-17T04:35:02.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.625+0000 7f79627fc640 1 -- 172.21.15.43:0/4126427325 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f79680840f0 con 0x7f797006ddc0 2024-09-17T04:35:02.624 INFO:teuthology.orchestra.run.smithi043.stdout:68719476743 2024-09-17T04:35:02.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.628+0000 7f7953fff640 1 -- 172.21.15.43:0/4126427325 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7954078c10 msgr2=0x7f795407b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.628+0000 7f7953fff640 1 --2- 172.21.15.43:0/4126427325 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7954078c10 0x7f795407b120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f796c00a4d0 tx=0x7f796c00a460 comp rx=0 tx=0).stop 2024-09-17T04:35:02.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.629+0000 7f7953fff640 1 -- 172.21.15.43:0/4126427325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f797006ddc0 msgr2=0x7f79700cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.629+0000 7f7953fff640 1 --2- 172.21.15.43:0/4126427325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f797006ddc0 0x7f79700cbf00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7968009d60 tx=0x7f7968003f10 comp rx=0 tx=0).stop 2024-09-17T04:35:02.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.629+0000 7f7953fff640 1 -- 172.21.15.43:0/4126427325 shutdown_connections 2024-09-17T04:35:02.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.629+0000 7f7953fff640 1 --2- 172.21.15.43:0/4126427325 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7954078c10 0x7f795407b120 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.629+0000 7f7953fff640 1 --2- 172.21.15.43:0/4126427325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79700c3a80 0x7f797015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.629+0000 7f7953fff640 1 --2- 172.21.15.43:0/4126427325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f797015ede0 0x7f797015df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.629+0000 7f7953fff640 1 --2- 172.21.15.43:0/4126427325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f797006ddc0 0x7f79700cbf00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.629+0000 7f7953fff640 1 -- 172.21.15.43:0/4126427325 >> 172.21.15.43:0/4126427325 conn(0x7f7970070540 msgr2=0x7f79700c30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:02.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.630+0000 7f7953fff640 1 -- 172.21.15.43:0/4126427325 shutdown_connections 2024-09-17T04:35:02.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.630+0000 7f7953fff640 1 -- 172.21.15.43:0/4126427325 wait complete. 2024-09-17T04:35:02.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.4 2024-09-17T04:35:02.647 DEBUG:teuthology.parallel:result is None 2024-09-17T04:35:02.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.691+0000 7fa837fff640 1 -- 172.21.15.43:0/1267701990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa830033cd0 con 0x7fa83004c5b0 2024-09-17T04:35:02.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.692+0000 7fa81f7fe640 1 -- 172.21.15.43:0/1267701990 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa82c063680 con 0x7fa83004c5b0 2024-09-17T04:35:02.691 INFO:teuthology.orchestra.run.smithi043.stdout:68719476743 2024-09-17T04:35:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.694+0000 7fa837fff640 1 -- 172.21.15.43:0/1267701990 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fa824078b90 msgr2=0x7fa82407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.694+0000 7fa837fff640 1 --2- 172.21.15.43:0/1267701990 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fa824078b90 0x7fa82407b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa828037000 tx=0x7fa828004730 comp rx=0 tx=0).stop 2024-09-17T04:35:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.694+0000 7fa837fff640 1 -- 172.21.15.43:0/1267701990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa83004c5b0 msgr2=0x7fa8300ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.694+0000 7fa837fff640 1 --2- 172.21.15.43:0/1267701990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa83004c5b0 0x7fa8300ce190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00c4b0 tx=0x7fa82c00c970 comp rx=0 tx=0).stop 2024-09-17T04:35:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.694+0000 7fa837fff640 1 -- 172.21.15.43:0/1267701990 shutdown_connections 2024-09-17T04:35:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.694+0000 7fa837fff640 1 --2- 172.21.15.43:0/1267701990 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fa824078b90 0x7fa82407b0a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.694+0000 7fa837fff640 1 --2- 172.21.15.43:0/1267701990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8300d5070 0x7fa8300d0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.694+0000 7fa837fff640 1 --2- 172.21.15.43:0/1267701990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa83004c5b0 0x7fa8300ce190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.694+0000 7fa837fff640 1 --2- 172.21.15.43:0/1267701990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa830045c00 0x7fa8300d2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.694+0000 7fa837fff640 1 -- 172.21.15.43:0/1267701990 >> 172.21.15.43:0/1267701990 conn(0x7fa830050280 msgr2=0x7fa830005780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:02.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.694+0000 7fa837fff640 1 -- 172.21.15.43:0/1267701990 shutdown_connections 2024-09-17T04:35:02.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.694+0000 7fa837fff640 1 -- 172.21.15.43:0/1267701990 wait complete. 2024-09-17T04:35:02.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.7 2024-09-17T04:35:02.706 DEBUG:teuthology.parallel:result is None 2024-09-17T04:35:02.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.712+0000 7feec0cfc640 1 -- 172.21.15.43:0/2755251326 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7feeb4006cd0 con 0x7feeb4045540 2024-09-17T04:35:02.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.713+0000 7feea7fff640 1 -- 172.21.15.43:0/2755251326 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feea8084380 con 0x7feeb4045540 2024-09-17T04:35:02.713 INFO:teuthology.orchestra.run.smithi043.stdout:68719476743 2024-09-17T04:35:02.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.714+0000 7f3830970640 1 -- 172.21.15.43:0/1403430123 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f380c005580 con 0x7f382404c9b0 2024-09-17T04:35:02.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.715+0000 7f38137fe640 1 -- 172.21.15.43:0/1403430123 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f381c0626d0 con 0x7f382404c9b0 2024-09-17T04:35:02.715 INFO:teuthology.orchestra.run.smithi043.stdout:60129542151 2024-09-17T04:35:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.716+0000 7feec0cfc640 1 -- 172.21.15.43:0/2755251326 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7feea0078b90 msgr2=0x7feea007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.716+0000 7feec0cfc640 1 --2- 172.21.15.43:0/2755251326 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7feea0078b90 0x7feea007b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feebc051d10 tx=0x7feebc070040 comp rx=0 tx=0).stop 2024-09-17T04:35:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.716+0000 7feec0cfc640 1 -- 172.21.15.43:0/2755251326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb4045540 msgr2=0x7feeb40ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.716+0000 7feec0cfc640 1 --2- 172.21.15.43:0/2755251326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb4045540 0x7feeb40ca460 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feea8031000 tx=0x7feea80045c0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.716+0000 7feec0cfc640 1 -- 172.21.15.43:0/2755251326 shutdown_connections 2024-09-17T04:35:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.716+0000 7feec0cfc640 1 --2- 172.21.15.43:0/2755251326 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7feea0078b90 0x7feea007b0a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.716+0000 7feec0cfc640 1 --2- 172.21.15.43:0/2755251326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feeb404c9b0 0x7feeb40d7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.716+0000 7feec0cfc640 1 --2- 172.21.15.43:0/2755251326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb4045540 0x7feeb40ca460 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.716+0000 7feec0cfc640 1 --2- 172.21.15.43:0/2755251326 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feeb4005fe0 0x7feeb4175560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.716+0000 7feec0cfc640 1 -- 172.21.15.43:0/2755251326 >> 172.21.15.43:0/2755251326 conn(0x7feeb40506c0 msgr2=0x7feeb404d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.717+0000 7feec0cfc640 1 -- 172.21.15.43:0/2755251326 shutdown_connections 2024-09-17T04:35:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.717+0000 7feec0cfc640 1 -- 172.21.15.43:0/2755251326 wait complete. 2024-09-17T04:35:02.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.718+0000 7f3830970640 1 -- 172.21.15.43:0/1403430123 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f3818078c60 msgr2=0x7f381807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.718+0000 7f3830970640 1 --2- 172.21.15.43:0/1403430123 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f3818078c60 0x7f381807b170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f38240d2e90 tx=0x7f3820009040 comp rx=0 tx=0).stop 2024-09-17T04:35:02.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.718+0000 7f3830970640 1 -- 172.21.15.43:0/1403430123 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f382404c9b0 msgr2=0x7f3824174620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.718+0000 7f3830970640 1 --2- 172.21.15.43:0/1403430123 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f382404c9b0 0x7f3824174620 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f381c00c430 tx=0x7f381c00c8f0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.718+0000 7f3830970640 1 -- 172.21.15.43:0/1403430123 shutdown_connections 2024-09-17T04:35:02.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.718+0000 7f3830970640 1 --2- 172.21.15.43:0/1403430123 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f3818078c60 0x7f381807b170 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.718+0000 7f3830970640 1 --2- 172.21.15.43:0/1403430123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38240de5e0 0x7f38240d2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.718+0000 7f3830970640 1 --2- 172.21.15.43:0/1403430123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38240d5240 0x7f38240caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.718+0000 7f3830970640 1 --2- 172.21.15.43:0/1403430123 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f382404c9b0 0x7f3824174620 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.718+0000 7f3830970640 1 -- 172.21.15.43:0/1403430123 >> 172.21.15.43:0/1403430123 conn(0x7f38240506c0 msgr2=0x7f38240d38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:02.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.718+0000 7f3830970640 1 -- 172.21.15.43:0/1403430123 shutdown_connections 2024-09-17T04:35:02.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.718+0000 7f3830970640 1 -- 172.21.15.43:0/1403430123 wait complete. 2024-09-17T04:35:02.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.722+0000 7fcf87b4a640 1 -- 172.21.15.43:0/3350988504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fcf68005850 con 0x7fcf80070640 2024-09-17T04:35:02.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.723+0000 7fcf767fc640 1 -- 172.21.15.43:0/3350988504 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcf70087b10 con 0x7fcf80070640 2024-09-17T04:35:02.723 INFO:teuthology.orchestra.run.smithi043.stdout:60129542152 2024-09-17T04:35:02.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.727+0000 7fcf87b4a640 1 -- 172.21.15.43:0/3350988504 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fcf64078b90 msgr2=0x7fcf6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.727+0000 7fcf87b4a640 1 --2- 172.21.15.43:0/3350988504 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fcf64078b90 0x7fcf6407b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009f30 tx=0x7fcf78009680 comp rx=0 tx=0).stop 2024-09-17T04:35:02.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.727+0000 7fcf87b4a640 1 -- 172.21.15.43:0/3350988504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf80070640 msgr2=0x7fcf801f1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.727+0000 7fcf87b4a640 1 --2- 172.21.15.43:0/3350988504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf80070640 0x7fcf801f1920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcf70031000 tx=0x7fcf70003820 comp rx=0 tx=0).stop 2024-09-17T04:35:02.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.727+0000 7fcf87b4a640 1 -- 172.21.15.43:0/3350988504 shutdown_connections 2024-09-17T04:35:02.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.727+0000 7fcf87b4a640 1 --2- 172.21.15.43:0/3350988504 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fcf64078b90 0x7fcf6407b0a0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009f30 tx=0x7fcf78009680 comp rx=0 tx=0).stop 2024-09-17T04:35:02.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.727+0000 7fcf87b4a640 1 --2- 172.21.15.43:0/3350988504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf800c2f40 0x7fcf801f1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.727+0000 7fcf87b4a640 1 --2- 172.21.15.43:0/3350988504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf80070640 0x7fcf801f1920 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.727+0000 7fcf87b4a640 1 --2- 172.21.15.43:0/3350988504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf8006e8a0 0x7fcf801490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.727+0000 7fcf87b4a640 1 -- 172.21.15.43:0/3350988504 >> 172.21.15.43:0/3350988504 conn(0x7fcf800738e0 msgr2=0x7fcf800c9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:02.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.727+0000 7f420108a640 1 -- 172.21.15.43:0/142687400 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f41f4005a40 con 0x7f41f40df620 2024-09-17T04:35:02.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.727+0000 7fcf87b4a640 1 -- 172.21.15.43:0/3350988504 shutdown_connections 2024-09-17T04:35:02.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.727+0000 7fcf87b4a640 1 -- 172.21.15.43:0/3350988504 wait complete. 2024-09-17T04:35:02.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.727+0000 7f41f8ff9640 1 -- 172.21.15.43:0/142687400 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f41f4005a40 con 0x7f41f40df620 2024-09-17T04:35:02.728 INFO:teuthology.orchestra.run.smithi043.stdout:60129542151 2024-09-17T04:35:02.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.731+0000 7f420108a640 1 -- 172.21.15.43:0/142687400 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f41e0078bc0 msgr2=0x7f41e007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.731+0000 7f420108a640 1 --2- 172.21.15.43:0/142687400 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f41e0078bc0 0x7f41e007b0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f41e8006fd0 tx=0x7f41e8009060 comp rx=0 tx=0).stop 2024-09-17T04:35:02.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.731+0000 7f420108a640 1 -- 172.21.15.43:0/142687400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41f40df620 msgr2=0x7f41f4169b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.731+0000 7f420108a640 1 --2- 172.21.15.43:0/142687400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41f40df620 0x7f41f4169b40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f41fc06a550 tx=0x7f41fc0b55e0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.732+0000 7f420108a640 1 -- 172.21.15.43:0/142687400 shutdown_connections 2024-09-17T04:35:02.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.732+0000 7f420108a640 1 --2- 172.21.15.43:0/142687400 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f41e0078bc0 0x7f41e007b0d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.732+0000 7f420108a640 1 --2- 172.21.15.43:0/142687400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41f40df620 0x7f41f4169b40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.732+0000 7f420108a640 1 --2- 172.21.15.43:0/142687400 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41f404b370 0x7f41f416a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.732+0000 7f420108a640 1 --2- 172.21.15.43:0/142687400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41f4044d20 0x7f41f4048010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.732+0000 7f420108a640 1 -- 172.21.15.43:0/142687400 >> 172.21.15.43:0/142687400 conn(0x7f41f404fe30 msgr2=0x7f41f4005330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:02.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.732+0000 7f420108a640 1 -- 172.21.15.43:0/142687400 shutdown_connections 2024-09-17T04:35:02.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.732+0000 7f420108a640 1 -- 172.21.15.43:0/142687400 wait complete. 2024-09-17T04:35:02.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.6 2024-09-17T04:35:02.733 DEBUG:teuthology.parallel:result is None 2024-09-17T04:35:02.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.3 2024-09-17T04:35:02.734 DEBUG:teuthology.parallel:result is None 2024-09-17T04:35:02.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.738+0000 7f1d92827640 1 -- 172.21.15.43:0/1729295174 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1d6c005850 con 0x7f1d8c072a80 2024-09-17T04:35:02.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.739+0000 7f1d88ff9640 1 -- 172.21.15.43:0/1729295174 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1d84063280 con 0x7f1d8c072a80 2024-09-17T04:35:02.739 INFO:teuthology.orchestra.run.smithi043.stdout:60129542152 2024-09-17T04:35:02.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.739+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/3747199328 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7e98005850 con 0x7f7eb40741e0 2024-09-17T04:35:02.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.739+0000 7f7eb0ff9640 1 -- 172.21.15.43:0/3747199328 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7eb40c7f20 con 0x7f7eb40741e0 2024-09-17T04:35:02.739 INFO:teuthology.orchestra.run.smithi043.stdout:68719476743 2024-09-17T04:35:02.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.742+0000 7f1d92827640 1 -- 172.21.15.43:0/1729295174 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1d70078bc0 msgr2=0x7f1d7007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.742+0000 7f1d92827640 1 --2- 172.21.15.43:0/1729295174 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1d70078bc0 0x7f1d7007b0d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c1f0d40 tx=0x7f1d78007df0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.742+0000 7f1d92827640 1 -- 172.21.15.43:0/1729295174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d8c072a80 msgr2=0x7f1d8c1ed780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.742+0000 7f1d92827640 1 --2- 172.21.15.43:0/1729295174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d8c072a80 0x7f1d8c1ed780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400c0f0 tx=0x7f1d8400c5b0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.742+0000 7f1d92827640 1 -- 172.21.15.43:0/1729295174 shutdown_connections 2024-09-17T04:35:02.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.742+0000 7f1d92827640 1 --2- 172.21.15.43:0/1729295174 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1d70078bc0 0x7f1d7007b0d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.742+0000 7f1d92827640 1 --2- 172.21.15.43:0/1729295174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c0ca610 0x7f1d8c148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.742+0000 7f1d92827640 1 --2- 172.21.15.43:0/1729295174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d8c074bf0 0x7f1d8c0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.742+0000 7f1d92827640 1 --2- 172.21.15.43:0/1729295174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d8c072a80 0x7f1d8c1ed780 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.742+0000 7f1d92827640 1 -- 172.21.15.43:0/1729295174 >> 172.21.15.43:0/1729295174 conn(0x7f1d8c0c9af0 msgr2=0x7f1d8c06ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:02.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.742+0000 7f1d92827640 1 -- 172.21.15.43:0/1729295174 shutdown_connections 2024-09-17T04:35:02.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.742+0000 7f1d92827640 1 -- 172.21.15.43:0/1729295174 wait complete. 2024-09-17T04:35:02.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.743+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/3747199328 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7e94078d90 msgr2=0x7f7e9407b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.743+0000 7f7eb8bd6640 1 --2- 172.21.15.43:0/3747199328 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7e94078d90 0x7f7e9407b2a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ea400a490 tx=0x7f7ea400a420 comp rx=0 tx=0).stop 2024-09-17T04:35:02.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.743+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/3747199328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7eb40741e0 msgr2=0x7f7eb415d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.743+0000 7f7eb8bd6640 1 --2- 172.21.15.43:0/3747199328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7eb40741e0 0x7f7eb415d150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00c400 tx=0x7f7e9c00c8c0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.743+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/3747199328 shutdown_connections 2024-09-17T04:35:02.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.743+0000 7f7eb8bd6640 1 --2- 172.21.15.43:0/3747199328 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f7e94078d90 0x7f7e9407b2a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.743+0000 7f7eb8bd6640 1 --2- 172.21.15.43:0/3747199328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7eb40c7b10 0x7f7eb4154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.743+0000 7f7eb8bd6640 1 --2- 172.21.15.43:0/3747199328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7eb40741e0 0x7f7eb415d150 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00c400 tx=0x7f7e9c00c8c0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.743+0000 7f7eb8bd6640 1 --2- 172.21.15.43:0/3747199328 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7eb4070b70 0x7f7eb414d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.743+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/3747199328 >> 172.21.15.43:0/3747199328 conn(0x7f7eb40cd290 msgr2=0x7f7eb40ca3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:02.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.743+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/3747199328 shutdown_connections 2024-09-17T04:35:02.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.743+0000 7f7eb8bd6640 1 -- 172.21.15.43:0/3747199328 wait complete. 2024-09-17T04:35:02.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.1 2024-09-17T04:35:02.745 DEBUG:teuthology.parallel:result is None 2024-09-17T04:35:02.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2024-09-17T04:35:02.747 DEBUG:teuthology.parallel:result is None 2024-09-17T04:35:02.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.0 2024-09-17T04:35:02.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.5 2024-09-17T04:35:02.755 DEBUG:teuthology.parallel:result is None 2024-09-17T04:35:02.756 DEBUG:teuthology.parallel:result is None 2024-09-17T04:35:02.756 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T04:35:02.756 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:35:02.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.913+0000 7f47448d5640 1 -- 172.21.15.43:0/105299268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47280051c0 msgr2=0x7f472800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.913+0000 7f47448d5640 1 --2- 172.21.15.43:0/105299268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47280051c0 0x7f472800b9c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4738005fd0 tx=0x7f4728005830 comp rx=0 tx=0).stop 2024-09-17T04:35:02.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.913+0000 7f47448d5640 1 -- 172.21.15.43:0/105299268 shutdown_connections 2024-09-17T04:35:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.913+0000 7f47448d5640 1 --2- 172.21.15.43:0/105299268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47280051c0 0x7f472800b9c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.913+0000 7f47448d5640 1 -- 172.21.15.43:0/105299268 >> 172.21.15.43:0/105299268 conn(0x7f4740072f60 msgr2=0x7f47400cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.913+0000 7f47448d5640 1 -- 172.21.15.43:0/105299268 shutdown_connections 2024-09-17T04:35:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.913+0000 7f47448d5640 1 -- 172.21.15.43:0/105299268 wait complete. 2024-09-17T04:35:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.915+0000 7f47448d5640 1 Processor -- start 2024-09-17T04:35:02.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.915+0000 7f47448d5640 1 -- start start 2024-09-17T04:35:02.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.916+0000 7f47448d5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47280051c0 0x7f47401ef7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.916+0000 7f47448d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f474015bbf0 0x7f474014bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.916+0000 7f47448d5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f474015c000 0x7f474014c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.916+0000 7f47448d5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4740153a50 con 0x7f47280051c0 2024-09-17T04:35:02.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.916+0000 7f47448d5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f47400c9a10 con 0x7f474015bbf0 2024-09-17T04:35:02.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.916+0000 7f47448d5640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4740153bd0 con 0x7f474015c000 2024-09-17T04:35:02.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.916+0000 7f473e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47280051c0 0x7f47401ef7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.916+0000 7f473e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47280051c0 0x7f47401ef7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35518/0 (socket says 172.21.15.43:35518) 2024-09-17T04:35:02.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.916+0000 7f473e59c640 1 -- 172.21.15.43:0/685001106 learned_addr learned my addr 172.21.15.43:0/685001106 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:02.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.916+0000 7f473dd9b640 1 --2- 172.21.15.43:0/685001106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f474015bbf0 0x7f474014bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.916+0000 7f473ed9d640 1 --2- 172.21.15.43:0/685001106 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f474015c000 0x7f474014c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.917+0000 7f473e59c640 1 -- 172.21.15.43:0/685001106 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f474015c000 msgr2=0x7f474014c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.917+0000 7f473e59c640 1 --2- 172.21.15.43:0/685001106 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f474015c000 0x7f474014c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.917+0000 7f473e59c640 1 -- 172.21.15.43:0/685001106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f474015bbf0 msgr2=0x7f474014bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:02.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.917+0000 7f473e59c640 1 --2- 172.21.15.43:0/685001106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f474015bbf0 0x7f474014bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:02.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.917+0000 7f473e59c640 1 -- 172.21.15.43:0/685001106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f474015c940 con 0x7f47280051c0 2024-09-17T04:35:02.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.917+0000 7f473e59c640 1 --2- 172.21.15.43:0/685001106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47280051c0 0x7f47401ef7e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4730006430 tx=0x7f47300039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.917+0000 7f472effd640 1 -- 172.21.15.43:0/685001106 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4730015070 con 0x7f47280051c0 2024-09-17T04:35:02.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.917+0000 7f472effd640 1 -- 172.21.15.43:0/685001106 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4730011840 con 0x7f47280051c0 2024-09-17T04:35:02.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.917+0000 7f47448d5640 1 -- 172.21.15.43:0/685001106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47401efd20 con 0x7f47280051c0 2024-09-17T04:35:02.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.917+0000 7f472effd640 1 -- 172.21.15.43:0/685001106 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4730011c30 con 0x7f47280051c0 2024-09-17T04:35:02.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.917+0000 7f47448d5640 1 -- 172.21.15.43:0/685001106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47401f3070 con 0x7f47280051c0 2024-09-17T04:35:02.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.918+0000 7f47448d5640 1 -- 172.21.15.43:0/685001106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47400cc9a0 con 0x7f47280051c0 2024-09-17T04:35:02.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.919+0000 7f472effd640 1 -- 172.21.15.43:0/685001106 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4730018070 con 0x7f47280051c0 2024-09-17T04:35:02.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.919+0000 7f472effd640 1 --2- 172.21.15.43:0/685001106 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4720078bc0 0x7f472007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:02.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.919+0000 7f472effd640 1 -- 172.21.15.43:0/685001106 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f473009b870 con 0x7f47280051c0 2024-09-17T04:35:02.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.919+0000 7f473dd9b640 1 --2- 172.21.15.43:0/685001106 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4720078bc0 0x7f472007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:02.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.920+0000 7f473dd9b640 1 --2- 172.21.15.43:0/685001106 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4720078bc0 0x7f472007b0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f474014dc90 tx=0x7f4734006b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:02.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:02.924+0000 7f472effd640 1 -- 172.21.15.43:0/685001106 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f47400cc9a0 con 0x7f47280051c0 2024-09-17T04:35:03.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.105+0000 7f47448d5640 1 -- 172.21.15.43:0/685001106 --> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4740071630 con 0x7f4720078bc0 2024-09-17T04:35:03.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.112+0000 7f472effd640 1 -- 172.21.15.43:0/685001106 <== mgr.4100 v2:172.21.15.62:6800/1186143747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7f4740071630 con 0x7f4720078bc0 2024-09-17T04:35:03.115 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:35:03.116 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-17T04:35:03.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.115+0000 7f47448d5640 1 -- 172.21.15.43:0/685001106 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4720078bc0 msgr2=0x7f472007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:03.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.116+0000 7f47448d5640 1 --2- 172.21.15.43:0/685001106 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4720078bc0 0x7f472007b0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f474014dc90 tx=0x7f4734006b10 comp rx=0 tx=0).stop 2024-09-17T04:35:03.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.116+0000 7f47448d5640 1 -- 172.21.15.43:0/685001106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47280051c0 msgr2=0x7f47401ef7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:03.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.116+0000 7f47448d5640 1 --2- 172.21.15.43:0/685001106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47280051c0 0x7f47401ef7e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4730006430 tx=0x7f47300039c0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.116+0000 7f47448d5640 1 -- 172.21.15.43:0/685001106 shutdown_connections 2024-09-17T04:35:03.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.116+0000 7f47448d5640 1 --2- 172.21.15.43:0/685001106 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4720078bc0 0x7f472007b0d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.116+0000 7f47448d5640 1 --2- 172.21.15.43:0/685001106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f474015bbf0 0x7f474014bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.116+0000 7f47448d5640 1 --2- 172.21.15.43:0/685001106 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f474015c000 0x7f474014c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.116+0000 7f47448d5640 1 --2- 172.21.15.43:0/685001106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47280051c0 0x7f47401ef7e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.116+0000 7f47448d5640 1 -- 172.21.15.43:0/685001106 >> 172.21.15.43:0/685001106 conn(0x7f4740072f60 msgr2=0x7f4740149a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:03.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.116+0000 7f47448d5640 1 -- 172.21.15.43:0/685001106 shutdown_connections 2024-09-17T04:35:03.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.116+0000 7f47448d5640 1 -- 172.21.15.43:0/685001106 wait complete. 2024-09-17T04:35:03.128 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-17T04:35:02.892257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239912,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734808,"statfs":{"total":773094113280,"available":772848443392,"internally_reserved":0,"allocated":2990080,"data_stored":1797924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002726"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079958+0000","last_change":"2024-09-17T04:34:52.082794+0000","last_active":"2024-09-17T04:34:53.079958+0000","last_peered":"2024-09-17T04:34:53.079958+0000","last_clean":"2024-09-17T04:34:53.079958+0000","last_became_active":"2024-09-17T04:34:52.081216+0000","last_became_peered":"2024-09-17T04:34:52.081216+0000","last_unstale":"2024-09-17T04:34:53.079958+0000","last_undegraded":"2024-09-17T04:34:53.079958+0000","last_fullsized":"2024-09-17T04:34:53.079958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:32.229667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075998+0000","last_change":"2024-09-17T04:34:52.071762+0000","last_active":"2024-09-17T04:34:53.075998+0000","last_peered":"2024-09-17T04:34:53.075998+0000","last_clean":"2024-09-17T04:34:53.075998+0000","last_became_active":"2024-09-17T04:34:52.071488+0000","last_became_peered":"2024-09-17T04:34:52.071488+0000","last_unstale":"2024-09-17T04:34:53.075998+0000","last_undegraded":"2024-09-17T04:34:53.075998+0000","last_fullsized":"2024-09-17T04:34:53.075998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:00.729921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315645+0000","last_change":"2024-09-17T04:34:52.073360+0000","last_active":"2024-09-17T04:34:53.315645+0000","last_peered":"2024-09-17T04:34:53.315645+0000","last_clean":"2024-09-17T04:34:53.315645+0000","last_became_active":"2024-09-17T04:34:52.073014+0000","last_became_peered":"2024-09-17T04:34:52.073014+0000","last_unstale":"2024-09-17T04:34:53.315645+0000","last_undegraded":"2024-09-17T04:34:53.315645+0000","last_fullsized":"2024-09-17T04:34:53.315645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:14.331608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081622+0000","last_change":"2024-09-17T04:34:52.077679+0000","last_active":"2024-09-17T04:34:53.081622+0000","last_peered":"2024-09-17T04:34:53.081622+0000","last_clean":"2024-09-17T04:34:53.081622+0000","last_became_active":"2024-09-17T04:34:52.077306+0000","last_became_peered":"2024-09-17T04:34:52.077306+0000","last_unstale":"2024-09-17T04:34:53.081622+0000","last_undegraded":"2024-09-17T04:34:53.081622+0000","last_fullsized":"2024-09-17T04:34:53.081622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:44.967159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080748+0000","last_change":"2024-09-17T04:34:52.075036+0000","last_active":"2024-09-17T04:34:53.080748+0000","last_peered":"2024-09-17T04:34:53.080748+0000","last_clean":"2024-09-17T04:34:53.080748+0000","last_became_active":"2024-09-17T04:34:52.074649+0000","last_became_peered":"2024-09-17T04:34:52.074649+0000","last_unstale":"2024-09-17T04:34:53.080748+0000","last_undegraded":"2024-09-17T04:34:53.080748+0000","last_fullsized":"2024-09-17T04:34:53.080748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:22.293746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081410+0000","last_change":"2024-09-17T04:34:52.081059+0000","last_active":"2024-09-17T04:34:53.081410+0000","last_peered":"2024-09-17T04:34:53.081410+0000","last_clean":"2024-09-17T04:34:53.081410+0000","last_became_active":"2024-09-17T04:34:52.080677+0000","last_became_peered":"2024-09-17T04:34:52.080677+0000","last_unstale":"2024-09-17T04:34:53.081410+0000","last_undegraded":"2024-09-17T04:34:53.081410+0000","last_fullsized":"2024-09-17T04:34:53.081410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:52.404672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079328+0000","last_change":"2024-09-17T04:34:52.071135+0000","last_active":"2024-09-17T04:34:53.079328+0000","last_peered":"2024-09-17T04:34:53.079328+0000","last_clean":"2024-09-17T04:34:53.079328+0000","last_became_active":"2024-09-17T04:34:52.070844+0000","last_became_peered":"2024-09-17T04:34:52.070844+0000","last_unstale":"2024-09-17T04:34:53.079328+0000","last_undegraded":"2024-09-17T04:34:53.079328+0000","last_fullsized":"2024-09-17T04:34:53.079328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:02.373675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176836+0000","last_change":"2024-09-17T04:34:52.083343+0000","last_active":"2024-09-17T04:34:53.176836+0000","last_peered":"2024-09-17T04:34:53.176836+0000","last_clean":"2024-09-17T04:34:53.176836+0000","last_became_active":"2024-09-17T04:34:52.083008+0000","last_became_peered":"2024-09-17T04:34:52.083008+0000","last_unstale":"2024-09-17T04:34:53.176836+0000","last_undegraded":"2024-09-17T04:34:53.176836+0000","last_fullsized":"2024-09-17T04:34:53.176836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:02.710077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079639+0000","last_change":"2024-09-17T04:34:52.083331+0000","last_active":"2024-09-17T04:34:53.079639+0000","last_peered":"2024-09-17T04:34:53.079639+0000","last_clean":"2024-09-17T04:34:53.079639+0000","last_became_active":"2024-09-17T04:34:52.082984+0000","last_became_peered":"2024-09-17T04:34:52.082984+0000","last_unstale":"2024-09-17T04:34:53.079639+0000","last_undegraded":"2024-09-17T04:34:53.079639+0000","last_fullsized":"2024-09-17T04:34:53.079639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:56.779776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080623+0000","last_change":"2024-09-17T04:34:52.087207+0000","last_active":"2024-09-17T04:34:53.080623+0000","last_peered":"2024-09-17T04:34:53.080623+0000","last_clean":"2024-09-17T04:34:53.080623+0000","last_became_active":"2024-09-17T04:34:52.086885+0000","last_became_peered":"2024-09-17T04:34:52.086885+0000","last_unstale":"2024-09-17T04:34:53.080623+0000","last_undegraded":"2024-09-17T04:34:53.080623+0000","last_fullsized":"2024-09-17T04:34:53.080623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:52.121338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.078802+0000","last_change":"2024-09-17T04:34:52.086309+0000","last_active":"2024-09-17T04:34:53.078802+0000","last_peered":"2024-09-17T04:34:53.078802+0000","last_clean":"2024-09-17T04:34:53.078802+0000","last_became_active":"2024-09-17T04:34:52.085996+0000","last_became_peered":"2024-09-17T04:34:52.085996+0000","last_unstale":"2024-09-17T04:34:53.078802+0000","last_undegraded":"2024-09-17T04:34:53.078802+0000","last_fullsized":"2024-09-17T04:34:53.078802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:58.004980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318081+0000","last_change":"2024-09-17T04:34:52.077080+0000","last_active":"2024-09-17T04:34:53.318081+0000","last_peered":"2024-09-17T04:34:53.318081+0000","last_clean":"2024-09-17T04:34:53.318081+0000","last_became_active":"2024-09-17T04:34:52.076756+0000","last_became_peered":"2024-09-17T04:34:52.076756+0000","last_unstale":"2024-09-17T04:34:53.318081+0000","last_undegraded":"2024-09-17T04:34:53.318081+0000","last_fullsized":"2024-09-17T04:34:53.318081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:48.044400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177180+0000","last_change":"2024-09-17T04:34:52.076609+0000","last_active":"2024-09-17T04:34:53.177180+0000","last_peered":"2024-09-17T04:34:53.177180+0000","last_clean":"2024-09-17T04:34:53.177180+0000","last_became_active":"2024-09-17T04:34:52.076277+0000","last_became_peered":"2024-09-17T04:34:52.076277+0000","last_unstale":"2024-09-17T04:34:53.177180+0000","last_undegraded":"2024-09-17T04:34:53.177180+0000","last_fullsized":"2024-09-17T04:34:53.177180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:28.537566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315331+0000","last_change":"2024-09-17T04:34:52.076754+0000","last_active":"2024-09-17T04:34:53.315331+0000","last_peered":"2024-09-17T04:34:53.315331+0000","last_clean":"2024-09-17T04:34:53.315331+0000","last_became_active":"2024-09-17T04:34:52.076261+0000","last_became_peered":"2024-09-17T04:34:52.076261+0000","last_unstale":"2024-09-17T04:34:53.315331+0000","last_undegraded":"2024-09-17T04:34:53.315331+0000","last_fullsized":"2024-09-17T04:34:53.315331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:51.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075849+0000","last_change":"2024-09-17T04:34:52.079161+0000","last_active":"2024-09-17T04:34:53.075849+0000","last_peered":"2024-09-17T04:34:53.075849+0000","last_clean":"2024-09-17T04:34:53.075849+0000","last_became_active":"2024-09-17T04:34:52.078782+0000","last_became_peered":"2024-09-17T04:34:52.078782+0000","last_unstale":"2024-09-17T04:34:53.075849+0000","last_undegraded":"2024-09-17T04:34:53.075849+0000","last_fullsized":"2024-09-17T04:34:53.075849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:06.894137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080646+0000","last_change":"2024-09-17T04:34:52.070767+0000","last_active":"2024-09-17T04:34:53.080646+0000","last_peered":"2024-09-17T04:34:53.080646+0000","last_clean":"2024-09-17T04:34:53.080646+0000","last_became_active":"2024-09-17T04:34:52.070428+0000","last_became_peered":"2024-09-17T04:34:52.070428+0000","last_unstale":"2024-09-17T04:34:53.080646+0000","last_undegraded":"2024-09-17T04:34:53.080646+0000","last_fullsized":"2024-09-17T04:34:53.080646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:42.820391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.082014+0000","last_change":"2024-09-17T04:34:52.077238+0000","last_active":"2024-09-17T04:34:53.082014+0000","last_peered":"2024-09-17T04:34:53.082014+0000","last_clean":"2024-09-17T04:34:53.082014+0000","last_became_active":"2024-09-17T04:34:52.076897+0000","last_became_peered":"2024-09-17T04:34:52.076897+0000","last_unstale":"2024-09-17T04:34:53.082014+0000","last_undegraded":"2024-09-17T04:34:53.082014+0000","last_fullsized":"2024-09-17T04:34:53.082014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:27.431184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.316114+0000","last_change":"2024-09-17T04:34:52.080917+0000","last_active":"2024-09-17T04:34:53.316114+0000","last_peered":"2024-09-17T04:34:53.316114+0000","last_clean":"2024-09-17T04:34:53.316114+0000","last_became_active":"2024-09-17T04:34:52.080597+0000","last_became_peered":"2024-09-17T04:34:52.080597+0000","last_unstale":"2024-09-17T04:34:53.316114+0000","last_undegraded":"2024-09-17T04:34:53.316114+0000","last_fullsized":"2024-09-17T04:34:53.316114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:10.560075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080159+0000","last_change":"2024-09-17T04:34:52.077284+0000","last_active":"2024-09-17T04:34:53.080159+0000","last_peered":"2024-09-17T04:34:53.080159+0000","last_clean":"2024-09-17T04:34:53.080159+0000","last_became_active":"2024-09-17T04:34:52.076950+0000","last_became_peered":"2024-09-17T04:34:52.076950+0000","last_unstale":"2024-09-17T04:34:53.080159+0000","last_undegraded":"2024-09-17T04:34:53.080159+0000","last_fullsized":"2024-09-17T04:34:53.080159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:06.361530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079837+0000","last_change":"2024-09-17T04:34:52.083859+0000","last_active":"2024-09-17T04:34:53.079837+0000","last_peered":"2024-09-17T04:34:53.079837+0000","last_clean":"2024-09-17T04:34:53.079837+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:34:53.079837+0000","last_undegraded":"2024-09-17T04:34:53.079837+0000","last_fullsized":"2024-09-17T04:34:53.079837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:25.262925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315556+0000","last_change":"2024-09-17T04:34:52.086460+0000","last_active":"2024-09-17T04:34:53.315556+0000","last_peered":"2024-09-17T04:34:53.315556+0000","last_clean":"2024-09-17T04:34:53.315556+0000","last_became_active":"2024-09-17T04:34:52.084848+0000","last_became_peered":"2024-09-17T04:34:52.084848+0000","last_unstale":"2024-09-17T04:34:53.315556+0000","last_undegraded":"2024-09-17T04:34:53.315556+0000","last_fullsized":"2024-09-17T04:34:53.315556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:22.927331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081424+0000","last_change":"2024-09-17T04:34:52.080149+0000","last_active":"2024-09-17T04:34:53.081424+0000","last_peered":"2024-09-17T04:34:53.081424+0000","last_clean":"2024-09-17T04:34:53.081424+0000","last_became_active":"2024-09-17T04:34:52.079490+0000","last_became_peered":"2024-09-17T04:34:52.079490+0000","last_unstale":"2024-09-17T04:34:53.081424+0000","last_undegraded":"2024-09-17T04:34:53.081424+0000","last_fullsized":"2024-09-17T04:34:53.081424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:52.314715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176860+0000","last_change":"2024-09-17T04:34:52.082765+0000","last_active":"2024-09-17T04:34:53.176860+0000","last_peered":"2024-09-17T04:34:53.176860+0000","last_clean":"2024-09-17T04:34:53.176860+0000","last_became_active":"2024-09-17T04:34:52.081049+0000","last_became_peered":"2024-09-17T04:34:52.081049+0000","last_unstale":"2024-09-17T04:34:53.176860+0000","last_undegraded":"2024-09-17T04:34:53.176860+0000","last_fullsized":"2024-09-17T04:34:53.176860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.762553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081112+0000","last_change":"2024-09-17T04:34:52.086233+0000","last_active":"2024-09-17T04:34:53.081112+0000","last_peered":"2024-09-17T04:34:53.081112+0000","last_clean":"2024-09-17T04:34:53.081112+0000","last_became_active":"2024-09-17T04:34:52.085876+0000","last_became_peered":"2024-09-17T04:34:52.085876+0000","last_unstale":"2024-09-17T04:34:53.081112+0000","last_undegraded":"2024-09-17T04:34:53.081112+0000","last_fullsized":"2024-09-17T04:34:53.081112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:44.061677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177349+0000","last_change":"2024-09-17T04:34:52.079305+0000","last_active":"2024-09-17T04:34:53.177349+0000","last_peered":"2024-09-17T04:34:53.177349+0000","last_clean":"2024-09-17T04:34:53.177349+0000","last_became_active":"2024-09-17T04:34:52.078984+0000","last_became_peered":"2024-09-17T04:34:52.078984+0000","last_unstale":"2024-09-17T04:34:53.177349+0000","last_undegraded":"2024-09-17T04:34:53.177349+0000","last_fullsized":"2024-09-17T04:34:53.177349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:15.927488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080877+0000","last_change":"2024-09-17T04:34:52.077495+0000","last_active":"2024-09-17T04:34:53.080877+0000","last_peered":"2024-09-17T04:34:53.080877+0000","last_clean":"2024-09-17T04:34:53.080877+0000","last_became_active":"2024-09-17T04:34:52.077167+0000","last_became_peered":"2024-09-17T04:34:52.077167+0000","last_unstale":"2024-09-17T04:34:53.080877+0000","last_undegraded":"2024-09-17T04:34:53.080877+0000","last_fullsized":"2024-09-17T04:34:53.080877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.411611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076209+0000","last_change":"2024-09-17T04:34:52.077389+0000","last_active":"2024-09-17T04:34:53.076209+0000","last_peered":"2024-09-17T04:34:53.076209+0000","last_clean":"2024-09-17T04:34:53.076209+0000","last_became_active":"2024-09-17T04:34:52.076993+0000","last_became_peered":"2024-09-17T04:34:52.076993+0000","last_unstale":"2024-09-17T04:34:53.076209+0000","last_undegraded":"2024-09-17T04:34:53.076209+0000","last_fullsized":"2024-09-17T04:34:53.076209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:18.540098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177228+0000","last_change":"2024-09-17T04:34:52.080545+0000","last_active":"2024-09-17T04:34:53.177228+0000","last_peered":"2024-09-17T04:34:53.177228+0000","last_clean":"2024-09-17T04:34:53.177228+0000","last_became_active":"2024-09-17T04:34:52.079930+0000","last_became_peered":"2024-09-17T04:34:52.079930+0000","last_unstale":"2024-09-17T04:34:53.177228+0000","last_undegraded":"2024-09-17T04:34:53.177228+0000","last_fullsized":"2024-09-17T04:34:53.177228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:50.491050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315714+0000","last_change":"2024-09-17T04:34:52.083598+0000","last_active":"2024-09-17T04:34:53.315714+0000","last_peered":"2024-09-17T04:34:53.315714+0000","last_clean":"2024-09-17T04:34:53.315714+0000","last_became_active":"2024-09-17T04:34:52.083225+0000","last_became_peered":"2024-09-17T04:34:52.083225+0000","last_unstale":"2024-09-17T04:34:53.315714+0000","last_undegraded":"2024-09-17T04:34:53.315714+0000","last_fullsized":"2024-09-17T04:34:53.315714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:22.713546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081731+0000","last_change":"2024-09-17T04:34:52.078977+0000","last_active":"2024-09-17T04:34:53.081731+0000","last_peered":"2024-09-17T04:34:53.081731+0000","last_clean":"2024-09-17T04:34:53.081731+0000","last_became_active":"2024-09-17T04:34:52.078636+0000","last_became_peered":"2024-09-17T04:34:52.078636+0000","last_unstale":"2024-09-17T04:34:53.081731+0000","last_undegraded":"2024-09-17T04:34:53.081731+0000","last_fullsized":"2024-09-17T04:34:53.081731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:30.144564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315840+0000","last_change":"2024-09-17T04:34:52.082113+0000","last_active":"2024-09-17T04:34:53.315840+0000","last_peered":"2024-09-17T04:34:53.315840+0000","last_clean":"2024-09-17T04:34:53.315840+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:34:53.315840+0000","last_undegraded":"2024-09-17T04:34:53.315840+0000","last_fullsized":"2024-09-17T04:34:53.315840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:52.744564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.078708+0000","last_change":"2024-09-17T04:34:52.083306+0000","last_active":"2024-09-17T04:34:53.078708+0000","last_peered":"2024-09-17T04:34:53.078708+0000","last_clean":"2024-09-17T04:34:53.078708+0000","last_became_active":"2024-09-17T04:34:52.082590+0000","last_became_peered":"2024-09-17T04:34:52.082590+0000","last_unstale":"2024-09-17T04:34:53.078708+0000","last_undegraded":"2024-09-17T04:34:53.078708+0000","last_fullsized":"2024-09-17T04:34:53.078708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:21.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.317989+0000","last_change":"2024-09-17T04:34:52.070155+0000","last_active":"2024-09-17T04:34:53.317989+0000","last_peered":"2024-09-17T04:34:53.317989+0000","last_clean":"2024-09-17T04:34:53.317989+0000","last_became_active":"2024-09-17T04:34:52.069498+0000","last_became_peered":"2024-09-17T04:34:52.069498+0000","last_unstale":"2024-09-17T04:34:53.317989+0000","last_undegraded":"2024-09-17T04:34:53.317989+0000","last_fullsized":"2024-09-17T04:34:53.317989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:24.539277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:54.611120+0000","last_change":"2024-09-17T04:34:51.074188+0000","last_active":"2024-09-17T04:34:54.611120+0000","last_peered":"2024-09-17T04:34:54.611120+0000","last_clean":"2024-09-17T04:34:54.611120+0000","last_became_active":"2024-09-17T04:34:51.073740+0000","last_became_peered":"2024-09-17T04:34:51.073740+0000","last_unstale":"2024-09-17T04:34:54.611120+0000","last_undegraded":"2024-09-17T04:34:54.611120+0000","last_fullsized":"2024-09-17T04:34:54.611120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:36.692687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315954+0000","last_change":"2024-09-17T04:34:52.081048+0000","last_active":"2024-09-17T04:34:53.315954+0000","last_peered":"2024-09-17T04:34:53.315954+0000","last_clean":"2024-09-17T04:34:53.315954+0000","last_became_active":"2024-09-17T04:34:52.080703+0000","last_became_peered":"2024-09-17T04:34:52.080703+0000","last_unstale":"2024-09-17T04:34:53.315954+0000","last_undegraded":"2024-09-17T04:34:53.315954+0000","last_fullsized":"2024-09-17T04:34:53.315954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:05.164849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079248+0000","last_change":"2024-09-17T04:34:51.078602+0000","last_active":"2024-09-17T04:34:53.079248+0000","last_peered":"2024-09-17T04:34:53.079248+0000","last_clean":"2024-09-17T04:34:53.079248+0000","last_became_active":"2024-09-17T04:34:51.078221+0000","last_became_peered":"2024-09-17T04:34:51.078221+0000","last_unstale":"2024-09-17T04:34:53.079248+0000","last_undegraded":"2024-09-17T04:34:53.079248+0000","last_fullsized":"2024-09-17T04:34:53.079248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:59.716216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176933+0000","last_change":"2024-09-17T04:34:51.077573+0000","last_active":"2024-09-17T04:34:53.176933+0000","last_peered":"2024-09-17T04:34:53.176933+0000","last_clean":"2024-09-17T04:34:53.176933+0000","last_became_active":"2024-09-17T04:34:51.077225+0000","last_became_peered":"2024-09-17T04:34:51.077225+0000","last_unstale":"2024-09-17T04:34:53.176933+0000","last_undegraded":"2024-09-17T04:34:53.176933+0000","last_fullsized":"2024-09-17T04:34:53.176933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:29.348927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176928+0000","last_change":"2024-09-17T04:34:52.074356+0000","last_active":"2024-09-17T04:34:53.176928+0000","last_peered":"2024-09-17T04:34:53.176928+0000","last_clean":"2024-09-17T04:34:53.176928+0000","last_became_active":"2024-09-17T04:34:52.072796+0000","last_became_peered":"2024-09-17T04:34:52.072796+0000","last_unstale":"2024-09-17T04:34:53.176928+0000","last_undegraded":"2024-09-17T04:34:53.176928+0000","last_fullsized":"2024-09-17T04:34:53.176928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:53.971839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081155+0000","last_change":"2024-09-17T04:34:51.074170+0000","last_active":"2024-09-17T04:34:53.081155+0000","last_peered":"2024-09-17T04:34:53.081155+0000","last_clean":"2024-09-17T04:34:53.081155+0000","last_became_active":"2024-09-17T04:34:51.073836+0000","last_became_peered":"2024-09-17T04:34:51.073836+0000","last_unstale":"2024-09-17T04:34:53.081155+0000","last_undegraded":"2024-09-17T04:34:53.081155+0000","last_fullsized":"2024-09-17T04:34:53.081155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:30.884002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075826+0000","last_change":"2024-09-17T04:34:52.078331+0000","last_active":"2024-09-17T04:34:53.075826+0000","last_peered":"2024-09-17T04:34:53.075826+0000","last_clean":"2024-09-17T04:34:53.075826+0000","last_became_active":"2024-09-17T04:34:52.078012+0000","last_became_peered":"2024-09-17T04:34:52.078012+0000","last_unstale":"2024-09-17T04:34:53.075826+0000","last_undegraded":"2024-09-17T04:34:53.075826+0000","last_fullsized":"2024-09-17T04:34:53.075826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:28.961571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.078937+0000","last_change":"2024-09-17T04:34:51.077676+0000","last_active":"2024-09-17T04:34:53.078937+0000","last_peered":"2024-09-17T04:34:53.078937+0000","last_clean":"2024-09-17T04:34:53.078937+0000","last_became_active":"2024-09-17T04:34:51.076291+0000","last_became_peered":"2024-09-17T04:34:51.076291+0000","last_unstale":"2024-09-17T04:34:53.078937+0000","last_undegraded":"2024-09-17T04:34:53.078937+0000","last_fullsized":"2024-09-17T04:34:53.078937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:42.622688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081329+0000","last_change":"2024-09-17T04:34:52.075624+0000","last_active":"2024-09-17T04:34:53.081329+0000","last_peered":"2024-09-17T04:34:53.081329+0000","last_clean":"2024-09-17T04:34:53.081329+0000","last_became_active":"2024-09-17T04:34:52.074943+0000","last_became_peered":"2024-09-17T04:34:52.074943+0000","last_unstale":"2024-09-17T04:34:53.081329+0000","last_undegraded":"2024-09-17T04:34:53.081329+0000","last_fullsized":"2024-09-17T04:34:53.081329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:56.749605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081379+0000","last_change":"2024-09-17T04:34:51.077199+0000","last_active":"2024-09-17T04:34:53.081379+0000","last_peered":"2024-09-17T04:34:53.081379+0000","last_clean":"2024-09-17T04:34:53.081379+0000","last_became_active":"2024-09-17T04:34:51.076867+0000","last_became_peered":"2024-09-17T04:34:51.076867+0000","last_unstale":"2024-09-17T04:34:53.081379+0000","last_undegraded":"2024-09-17T04:34:53.081379+0000","last_fullsized":"2024-09-17T04:34:53.081379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:09.194133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315797+0000","last_change":"2024-09-17T04:34:52.083401+0000","last_active":"2024-09-17T04:34:53.315797+0000","last_peered":"2024-09-17T04:34:53.315797+0000","last_clean":"2024-09-17T04:34:53.315797+0000","last_became_active":"2024-09-17T04:34:52.083086+0000","last_became_peered":"2024-09-17T04:34:52.083086+0000","last_unstale":"2024-09-17T04:34:53.315797+0000","last_undegraded":"2024-09-17T04:34:53.315797+0000","last_fullsized":"2024-09-17T04:34:53.315797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.237945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.070035+0000","last_change":"2024-09-17T04:34:51.070235+0000","last_active":"2024-09-17T04:34:57.070035+0000","last_peered":"2024-09-17T04:34:57.070035+0000","last_clean":"2024-09-17T04:34:57.070035+0000","last_became_active":"2024-09-17T04:34:51.069278+0000","last_became_peered":"2024-09-17T04:34:51.069278+0000","last_unstale":"2024-09-17T04:34:57.070035+0000","last_undegraded":"2024-09-17T04:34:57.070035+0000","last_fullsized":"2024-09-17T04:34:57.070035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:55.959278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318073+0000","last_change":"2024-09-17T04:34:52.076233+0000","last_active":"2024-09-17T04:34:53.318073+0000","last_peered":"2024-09-17T04:34:53.318073+0000","last_clean":"2024-09-17T04:34:53.318073+0000","last_became_active":"2024-09-17T04:34:52.075682+0000","last_became_peered":"2024-09-17T04:34:52.075682+0000","last_unstale":"2024-09-17T04:34:53.318073+0000","last_undegraded":"2024-09-17T04:34:53.318073+0000","last_fullsized":"2024-09-17T04:34:53.318073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:22.047574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.068912+0000","last_change":"2024-09-17T04:34:51.076416+0000","last_active":"2024-09-17T04:34:57.068912+0000","last_peered":"2024-09-17T04:34:57.068912+0000","last_clean":"2024-09-17T04:34:57.068912+0000","last_became_active":"2024-09-17T04:34:51.076051+0000","last_became_peered":"2024-09-17T04:34:51.076051+0000","last_unstale":"2024-09-17T04:34:57.068912+0000","last_undegraded":"2024-09-17T04:34:57.068912+0000","last_fullsized":"2024-09-17T04:34:57.068912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:52.255204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079732+0000","last_change":"2024-09-17T04:34:52.086230+0000","last_active":"2024-09-17T04:34:53.079732+0000","last_peered":"2024-09-17T04:34:53.079732+0000","last_clean":"2024-09-17T04:34:53.079732+0000","last_became_active":"2024-09-17T04:34:52.085910+0000","last_became_peered":"2024-09-17T04:34:52.085910+0000","last_unstale":"2024-09-17T04:34:53.079732+0000","last_undegraded":"2024-09-17T04:34:53.079732+0000","last_fullsized":"2024-09-17T04:34:53.079732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:36.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.063451+0000","last_change":"2024-09-17T04:34:51.075224+0000","last_active":"2024-09-17T04:34:57.063451+0000","last_peered":"2024-09-17T04:34:57.063451+0000","last_clean":"2024-09-17T04:34:57.063451+0000","last_became_active":"2024-09-17T04:34:51.074912+0000","last_became_peered":"2024-09-17T04:34:51.074912+0000","last_unstale":"2024-09-17T04:34:57.063451+0000","last_undegraded":"2024-09-17T04:34:57.063451+0000","last_fullsized":"2024-09-17T04:34:57.063451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:33.811243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315617+0000","last_change":"2024-09-17T04:34:52.085906+0000","last_active":"2024-09-17T04:34:53.315617+0000","last_peered":"2024-09-17T04:34:53.315617+0000","last_clean":"2024-09-17T04:34:53.315617+0000","last_became_active":"2024-09-17T04:34:52.085538+0000","last_became_peered":"2024-09-17T04:34:52.085538+0000","last_unstale":"2024-09-17T04:34:53.315617+0000","last_undegraded":"2024-09-17T04:34:53.315617+0000","last_fullsized":"2024-09-17T04:34:53.315617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:21.997395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081689+0000","last_change":"2024-09-17T04:34:51.074253+0000","last_active":"2024-09-17T04:34:53.081689+0000","last_peered":"2024-09-17T04:34:53.081689+0000","last_clean":"2024-09-17T04:34:53.081689+0000","last_became_active":"2024-09-17T04:34:51.073812+0000","last_became_peered":"2024-09-17T04:34:51.073812+0000","last_unstale":"2024-09-17T04:34:53.081689+0000","last_undegraded":"2024-09-17T04:34:53.081689+0000","last_fullsized":"2024-09-17T04:34:53.081689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:38.971561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081022+0000","last_change":"2024-09-17T04:34:52.082137+0000","last_active":"2024-09-17T04:34:53.081022+0000","last_peered":"2024-09-17T04:34:53.081022+0000","last_clean":"2024-09-17T04:34:53.081022+0000","last_became_active":"2024-09-17T04:34:52.081775+0000","last_became_peered":"2024-09-17T04:34:52.081775+0000","last_unstale":"2024-09-17T04:34:53.081022+0000","last_undegraded":"2024-09-17T04:34:53.081022+0000","last_fullsized":"2024-09-17T04:34:53.081022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:57.911822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080176+0000","last_change":"2024-09-17T04:34:51.077157+0000","last_active":"2024-09-17T04:34:53.080176+0000","last_peered":"2024-09-17T04:34:53.080176+0000","last_clean":"2024-09-17T04:34:53.080176+0000","last_became_active":"2024-09-17T04:34:51.076797+0000","last_became_peered":"2024-09-17T04:34:51.076797+0000","last_unstale":"2024-09-17T04:34:53.080176+0000","last_undegraded":"2024-09-17T04:34:53.080176+0000","last_fullsized":"2024-09-17T04:34:53.080176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:20.118978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079355+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:34:53.079355+0000","last_peered":"2024-09-17T04:34:53.079355+0000","last_clean":"2024-09-17T04:34:53.079355+0000","last_became_active":"2024-09-17T04:34:52.082118+0000","last_became_peered":"2024-09-17T04:34:52.082118+0000","last_unstale":"2024-09-17T04:34:53.079355+0000","last_undegraded":"2024-09-17T04:34:53.079355+0000","last_fullsized":"2024-09-17T04:34:53.079355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:44.752945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.066513+0000","last_change":"2024-09-17T04:34:51.071083+0000","last_active":"2024-09-17T04:34:57.066513+0000","last_peered":"2024-09-17T04:34:57.066513+0000","last_clean":"2024-09-17T04:34:57.066513+0000","last_became_active":"2024-09-17T04:34:51.070733+0000","last_became_peered":"2024-09-17T04:34:51.070733+0000","last_unstale":"2024-09-17T04:34:57.066513+0000","last_undegraded":"2024-09-17T04:34:57.066513+0000","last_fullsized":"2024-09-17T04:34:57.066513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:36.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079638+0000","last_change":"2024-09-17T04:34:52.080277+0000","last_active":"2024-09-17T04:34:53.079638+0000","last_peered":"2024-09-17T04:34:53.079638+0000","last_clean":"2024-09-17T04:34:53.079638+0000","last_became_active":"2024-09-17T04:34:52.079969+0000","last_became_peered":"2024-09-17T04:34:52.079969+0000","last_unstale":"2024-09-17T04:34:53.079638+0000","last_undegraded":"2024-09-17T04:34:53.079638+0000","last_fullsized":"2024-09-17T04:34:53.079638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:10.360905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318183+0000","last_change":"2024-09-17T04:34:51.074800+0000","last_active":"2024-09-17T04:34:53.318183+0000","last_peered":"2024-09-17T04:34:53.318183+0000","last_clean":"2024-09-17T04:34:53.318183+0000","last_became_active":"2024-09-17T04:34:51.073287+0000","last_became_peered":"2024-09-17T04:34:51.073287+0000","last_unstale":"2024-09-17T04:34:53.318183+0000","last_undegraded":"2024-09-17T04:34:53.318183+0000","last_fullsized":"2024-09-17T04:34:53.318183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:19.933857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079619+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:34:53.079619+0000","last_peered":"2024-09-17T04:34:53.079619+0000","last_clean":"2024-09-17T04:34:53.079619+0000","last_became_active":"2024-09-17T04:34:52.082607+0000","last_became_peered":"2024-09-17T04:34:52.082607+0000","last_unstale":"2024-09-17T04:34:53.079619+0000","last_undegraded":"2024-09-17T04:34:53.079619+0000","last_fullsized":"2024-09-17T04:34:53.079619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:08.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.064837+0000","last_change":"2024-09-17T04:34:51.077171+0000","last_active":"2024-09-17T04:34:57.064837+0000","last_peered":"2024-09-17T04:34:57.064837+0000","last_clean":"2024-09-17T04:34:57.064837+0000","last_became_active":"2024-09-17T04:34:51.076780+0000","last_became_peered":"2024-09-17T04:34:51.076780+0000","last_unstale":"2024-09-17T04:34:57.064837+0000","last_undegraded":"2024-09-17T04:34:57.064837+0000","last_fullsized":"2024-09-17T04:34:57.064837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:40.031852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079942+0000","last_change":"2024-09-17T04:34:52.080032+0000","last_active":"2024-09-17T04:34:53.079942+0000","last_peered":"2024-09-17T04:34:53.079942+0000","last_clean":"2024-09-17T04:34:53.079942+0000","last_became_active":"2024-09-17T04:34:52.079536+0000","last_became_peered":"2024-09-17T04:34:52.079536+0000","last_unstale":"2024-09-17T04:34:53.079942+0000","last_undegraded":"2024-09-17T04:34:53.079942+0000","last_fullsized":"2024-09-17T04:34:53.079942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:55.220027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:54.608800+0000","last_change":"2024-09-17T04:34:51.071053+0000","last_active":"2024-09-17T04:34:54.608800+0000","last_peered":"2024-09-17T04:34:54.608800+0000","last_clean":"2024-09-17T04:34:54.608800+0000","last_became_active":"2024-09-17T04:34:51.070673+0000","last_became_peered":"2024-09-17T04:34:51.070673+0000","last_unstale":"2024-09-17T04:34:54.608800+0000","last_undegraded":"2024-09-17T04:34:54.608800+0000","last_fullsized":"2024-09-17T04:34:54.608800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:31.660200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081894+0000","last_change":"2024-09-17T04:34:52.077963+0000","last_active":"2024-09-17T04:34:53.081894+0000","last_peered":"2024-09-17T04:34:53.081894+0000","last_clean":"2024-09-17T04:34:53.081894+0000","last_became_active":"2024-09-17T04:34:52.077499+0000","last_became_peered":"2024-09-17T04:34:52.077499+0000","last_unstale":"2024-09-17T04:34:53.081894+0000","last_undegraded":"2024-09-17T04:34:53.081894+0000","last_fullsized":"2024-09-17T04:34:53.081894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:25.309696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.316030+0000","last_change":"2024-09-17T04:34:51.070532+0000","last_active":"2024-09-17T04:34:53.316030+0000","last_peered":"2024-09-17T04:34:53.316030+0000","last_clean":"2024-09-17T04:34:53.316030+0000","last_became_active":"2024-09-17T04:34:51.070179+0000","last_became_peered":"2024-09-17T04:34:51.070179+0000","last_unstale":"2024-09-17T04:34:53.316030+0000","last_undegraded":"2024-09-17T04:34:53.316030+0000","last_fullsized":"2024-09-17T04:34:53.316030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:52.027096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079935+0000","last_change":"2024-09-17T04:34:52.083159+0000","last_active":"2024-09-17T04:34:53.079935+0000","last_peered":"2024-09-17T04:34:53.079935+0000","last_clean":"2024-09-17T04:34:53.079935+0000","last_became_active":"2024-09-17T04:34:52.082847+0000","last_became_peered":"2024-09-17T04:34:52.082847+0000","last_unstale":"2024-09-17T04:34:53.079935+0000","last_undegraded":"2024-09-17T04:34:53.079935+0000","last_fullsized":"2024-09-17T04:34:53.079935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:25.210506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080417+0000","last_change":"2024-09-17T04:34:41.975789+0000","last_active":"2024-09-17T04:34:53.080417+0000","last_peered":"2024-09-17T04:34:53.080417+0000","last_clean":"2024-09-17T04:34:53.080417+0000","last_became_active":"2024-09-17T04:34:41.974664+0000","last_became_peered":"2024-09-17T04:34:41.974664+0000","last_unstale":"2024-09-17T04:34:53.080417+0000","last_undegraded":"2024-09-17T04:34:53.080417+0000","last_fullsized":"2024-09-17T04:34:53.080417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_clean_scrub_stamp":"2024-09-17T04:34:39.702713+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:30.302931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080987+0000","last_change":"2024-09-17T04:34:51.068782+0000","last_active":"2024-09-17T04:34:53.080987+0000","last_peered":"2024-09-17T04:34:53.080987+0000","last_clean":"2024-09-17T04:34:53.080987+0000","last_became_active":"2024-09-17T04:34:51.068375+0000","last_became_peered":"2024-09-17T04:34:51.068375+0000","last_unstale":"2024-09-17T04:34:53.080987+0000","last_undegraded":"2024-09-17T04:34:53.080987+0000","last_fullsized":"2024-09-17T04:34:53.080987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:25.307166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177343+0000","last_change":"2024-09-17T04:34:52.086768+0000","last_active":"2024-09-17T04:34:53.177343+0000","last_peered":"2024-09-17T04:34:53.177343+0000","last_clean":"2024-09-17T04:34:53.177343+0000","last_became_active":"2024-09-17T04:34:52.086415+0000","last_became_peered":"2024-09-17T04:34:52.086415+0000","last_unstale":"2024-09-17T04:34:53.177343+0000","last_undegraded":"2024-09-17T04:34:53.177343+0000","last_fullsized":"2024-09-17T04:34:53.177343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:45.527873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080288+0000","last_change":"2024-09-17T04:34:51.075655+0000","last_active":"2024-09-17T04:34:53.080288+0000","last_peered":"2024-09-17T04:34:53.080288+0000","last_clean":"2024-09-17T04:34:53.080288+0000","last_became_active":"2024-09-17T04:34:51.075313+0000","last_became_peered":"2024-09-17T04:34:51.075313+0000","last_unstale":"2024-09-17T04:34:53.080288+0000","last_undegraded":"2024-09-17T04:34:53.080288+0000","last_fullsized":"2024-09-17T04:34:53.080288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:47.853850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315306+0000","last_change":"2024-09-17T04:34:52.080065+0000","last_active":"2024-09-17T04:34:53.315306+0000","last_peered":"2024-09-17T04:34:53.315306+0000","last_clean":"2024-09-17T04:34:53.315306+0000","last_became_active":"2024-09-17T04:34:52.079672+0000","last_became_peered":"2024-09-17T04:34:52.079672+0000","last_unstale":"2024-09-17T04:34:53.315306+0000","last_undegraded":"2024-09-17T04:34:53.315306+0000","last_fullsized":"2024-09-17T04:34:53.315306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:52.040153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315786+0000","last_change":"2024-09-17T04:34:51.075960+0000","last_active":"2024-09-17T04:34:53.315786+0000","last_peered":"2024-09-17T04:34:53.315786+0000","last_clean":"2024-09-17T04:34:53.315786+0000","last_became_active":"2024-09-17T04:34:51.075561+0000","last_became_peered":"2024-09-17T04:34:51.075561+0000","last_unstale":"2024-09-17T04:34:53.315786+0000","last_undegraded":"2024-09-17T04:34:53.315786+0000","last_fullsized":"2024-09-17T04:34:53.315786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:44.834618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075859+0000","last_change":"2024-09-17T04:34:52.070068+0000","last_active":"2024-09-17T04:34:53.075859+0000","last_peered":"2024-09-17T04:34:53.075859+0000","last_clean":"2024-09-17T04:34:53.075859+0000","last_became_active":"2024-09-17T04:34:52.069669+0000","last_became_peered":"2024-09-17T04:34:52.069669+0000","last_unstale":"2024-09-17T04:34:53.075859+0000","last_undegraded":"2024-09-17T04:34:53.075859+0000","last_fullsized":"2024-09-17T04:34:53.075859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:39.617045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081829+0000","last_change":"2024-09-17T04:34:51.070187+0000","last_active":"2024-09-17T04:34:53.081829+0000","last_peered":"2024-09-17T04:34:53.081829+0000","last_clean":"2024-09-17T04:34:53.081829+0000","last_became_active":"2024-09-17T04:34:51.069714+0000","last_became_peered":"2024-09-17T04:34:51.069714+0000","last_unstale":"2024-09-17T04:34:53.081829+0000","last_undegraded":"2024-09-17T04:34:53.081829+0000","last_fullsized":"2024-09-17T04:34:53.081829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:28.082690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318145+0000","last_change":"2024-09-17T04:34:52.069653+0000","last_active":"2024-09-17T04:34:53.318145+0000","last_peered":"2024-09-17T04:34:53.318145+0000","last_clean":"2024-09-17T04:34:53.318145+0000","last_became_active":"2024-09-17T04:34:52.069282+0000","last_became_peered":"2024-09-17T04:34:52.069282+0000","last_unstale":"2024-09-17T04:34:53.318145+0000","last_undegraded":"2024-09-17T04:34:53.318145+0000","last_fullsized":"2024-09-17T04:34:53.318145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:40.828725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076208+0000","last_change":"2024-09-17T04:34:51.070676+0000","last_active":"2024-09-17T04:34:53.076208+0000","last_peered":"2024-09-17T04:34:53.076208+0000","last_clean":"2024-09-17T04:34:53.076208+0000","last_became_active":"2024-09-17T04:34:51.069006+0000","last_became_peered":"2024-09-17T04:34:51.069006+0000","last_unstale":"2024-09-17T04:34:53.076208+0000","last_undegraded":"2024-09-17T04:34:53.076208+0000","last_fullsized":"2024-09-17T04:34:53.076208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:45.452865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081804+0000","last_change":"2024-09-17T04:34:52.087131+0000","last_active":"2024-09-17T04:34:53.081804+0000","last_peered":"2024-09-17T04:34:53.081804+0000","last_clean":"2024-09-17T04:34:53.081804+0000","last_became_active":"2024-09-17T04:34:52.086782+0000","last_became_peered":"2024-09-17T04:34:52.086782+0000","last_unstale":"2024-09-17T04:34:53.081804+0000","last_undegraded":"2024-09-17T04:34:53.081804+0000","last_fullsized":"2024-09-17T04:34:53.081804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:53.987579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080352+0000","last_change":"2024-09-17T04:34:51.068708+0000","last_active":"2024-09-17T04:34:53.080352+0000","last_peered":"2024-09-17T04:34:53.080352+0000","last_clean":"2024-09-17T04:34:53.080352+0000","last_became_active":"2024-09-17T04:34:51.068354+0000","last_became_peered":"2024-09-17T04:34:51.068354+0000","last_unstale":"2024-09-17T04:34:53.080352+0000","last_undegraded":"2024-09-17T04:34:53.080352+0000","last_fullsized":"2024-09-17T04:34:53.080352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:04.219898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076122+0000","last_change":"2024-09-17T04:34:52.071586+0000","last_active":"2024-09-17T04:34:53.076122+0000","last_peered":"2024-09-17T04:34:53.076122+0000","last_clean":"2024-09-17T04:34:53.076122+0000","last_became_active":"2024-09-17T04:34:52.071246+0000","last_became_peered":"2024-09-17T04:34:52.071246+0000","last_unstale":"2024-09-17T04:34:53.076122+0000","last_undegraded":"2024-09-17T04:34:53.076122+0000","last_fullsized":"2024-09-17T04:34:53.076122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:03.620107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076048+0000","last_change":"2024-09-17T04:34:51.078947+0000","last_active":"2024-09-17T04:34:53.076048+0000","last_peered":"2024-09-17T04:34:53.076048+0000","last_clean":"2024-09-17T04:34:53.076048+0000","last_became_active":"2024-09-17T04:34:51.078557+0000","last_became_peered":"2024-09-17T04:34:51.078557+0000","last_unstale":"2024-09-17T04:34:53.076048+0000","last_undegraded":"2024-09-17T04:34:53.076048+0000","last_fullsized":"2024-09-17T04:34:53.076048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:51.413772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177384+0000","last_change":"2024-09-17T04:34:52.086372+0000","last_active":"2024-09-17T04:34:53.177384+0000","last_peered":"2024-09-17T04:34:53.177384+0000","last_clean":"2024-09-17T04:34:53.177384+0000","last_became_active":"2024-09-17T04:34:52.086018+0000","last_became_peered":"2024-09-17T04:34:52.086018+0000","last_unstale":"2024-09-17T04:34:53.177384+0000","last_undegraded":"2024-09-17T04:34:53.177384+0000","last_fullsized":"2024-09-17T04:34:53.177384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:10.818503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.068981+0000","last_change":"2024-09-17T04:34:51.076427+0000","last_active":"2024-09-17T04:34:57.068981+0000","last_peered":"2024-09-17T04:34:57.068981+0000","last_clean":"2024-09-17T04:34:57.068981+0000","last_became_active":"2024-09-17T04:34:51.075881+0000","last_became_peered":"2024-09-17T04:34:51.075881+0000","last_unstale":"2024-09-17T04:34:57.068981+0000","last_undegraded":"2024-09-17T04:34:57.068981+0000","last_fullsized":"2024-09-17T04:34:57.068981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:40.903989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315468+0000","last_change":"2024-09-17T04:34:52.076358+0000","last_active":"2024-09-17T04:34:53.315468+0000","last_peered":"2024-09-17T04:34:53.315468+0000","last_clean":"2024-09-17T04:34:53.315468+0000","last_became_active":"2024-09-17T04:34:52.076035+0000","last_became_peered":"2024-09-17T04:34:52.076035+0000","last_unstale":"2024-09-17T04:34:53.315468+0000","last_undegraded":"2024-09-17T04:34:53.315468+0000","last_fullsized":"2024-09-17T04:34:53.315468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:30.660617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080167+0000","last_change":"2024-09-17T04:34:51.072737+0000","last_active":"2024-09-17T04:34:53.080167+0000","last_peered":"2024-09-17T04:34:53.080167+0000","last_clean":"2024-09-17T04:34:53.080167+0000","last_became_active":"2024-09-17T04:34:51.072378+0000","last_became_peered":"2024-09-17T04:34:51.072378+0000","last_unstale":"2024-09-17T04:34:53.080167+0000","last_undegraded":"2024-09-17T04:34:53.080167+0000","last_fullsized":"2024-09-17T04:34:53.080167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:27.364636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318181+0000","last_change":"2024-09-17T04:34:52.068446+0000","last_active":"2024-09-17T04:34:53.318181+0000","last_peered":"2024-09-17T04:34:53.318181+0000","last_clean":"2024-09-17T04:34:53.318181+0000","last_became_active":"2024-09-17T04:34:52.068047+0000","last_became_peered":"2024-09-17T04:34:52.068047+0000","last_unstale":"2024-09-17T04:34:53.318181+0000","last_undegraded":"2024-09-17T04:34:53.318181+0000","last_fullsized":"2024-09-17T04:34:53.318181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:26.994189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075960+0000","last_change":"2024-09-17T04:34:51.069539+0000","last_active":"2024-09-17T04:34:53.075960+0000","last_peered":"2024-09-17T04:34:53.075960+0000","last_clean":"2024-09-17T04:34:53.075960+0000","last_became_active":"2024-09-17T04:34:51.067438+0000","last_became_peered":"2024-09-17T04:34:51.067438+0000","last_unstale":"2024-09-17T04:34:53.075960+0000","last_undegraded":"2024-09-17T04:34:53.075960+0000","last_fullsized":"2024-09-17T04:34:53.075960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:13.078391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177144+0000","last_change":"2024-09-17T04:34:52.078035+0000","last_active":"2024-09-17T04:34:53.177144+0000","last_peered":"2024-09-17T04:34:53.177144+0000","last_clean":"2024-09-17T04:34:53.177144+0000","last_became_active":"2024-09-17T04:34:52.077708+0000","last_became_peered":"2024-09-17T04:34:52.077708+0000","last_unstale":"2024-09-17T04:34:53.177144+0000","last_undegraded":"2024-09-17T04:34:53.177144+0000","last_fullsized":"2024-09-17T04:34:53.177144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:00.313209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076024+0000","last_change":"2024-09-17T04:34:51.074749+0000","last_active":"2024-09-17T04:34:53.076024+0000","last_peered":"2024-09-17T04:34:53.076024+0000","last_clean":"2024-09-17T04:34:53.076024+0000","last_became_active":"2024-09-17T04:34:51.074393+0000","last_became_peered":"2024-09-17T04:34:51.074393+0000","last_unstale":"2024-09-17T04:34:53.076024+0000","last_undegraded":"2024-09-17T04:34:53.076024+0000","last_fullsized":"2024-09-17T04:34:53.076024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:39.558815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177339+0000","last_change":"2024-09-17T04:34:52.075585+0000","last_active":"2024-09-17T04:34:53.177339+0000","last_peered":"2024-09-17T04:34:53.177339+0000","last_clean":"2024-09-17T04:34:53.177339+0000","last_became_active":"2024-09-17T04:34:52.075257+0000","last_became_peered":"2024-09-17T04:34:52.075257+0000","last_unstale":"2024-09-17T04:34:53.177339+0000","last_undegraded":"2024-09-17T04:34:53.177339+0000","last_fullsized":"2024-09-17T04:34:53.177339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:38.029256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.069392+0000","last_change":"2024-09-17T04:34:51.071324+0000","last_active":"2024-09-17T04:34:57.069392+0000","last_peered":"2024-09-17T04:34:57.069392+0000","last_clean":"2024-09-17T04:34:57.069392+0000","last_became_active":"2024-09-17T04:34:51.070944+0000","last_became_peered":"2024-09-17T04:34:51.070944+0000","last_unstale":"2024-09-17T04:34:57.069392+0000","last_undegraded":"2024-09-17T04:34:57.069392+0000","last_fullsized":"2024-09-17T04:34:57.069392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:13.931324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079005+0000","last_change":"2024-09-17T04:34:52.081178+0000","last_active":"2024-09-17T04:34:53.079005+0000","last_peered":"2024-09-17T04:34:53.079005+0000","last_clean":"2024-09-17T04:34:53.079005+0000","last_became_active":"2024-09-17T04:34:52.080855+0000","last_became_peered":"2024-09-17T04:34:52.080855+0000","last_unstale":"2024-09-17T04:34:53.079005+0000","last_undegraded":"2024-09-17T04:34:53.079005+0000","last_fullsized":"2024-09-17T04:34:53.079005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:49.091080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081719+0000","last_change":"2024-09-17T04:34:52.066633+0000","last_active":"2024-09-17T04:34:53.081719+0000","last_peered":"2024-09-17T04:34:53.081719+0000","last_clean":"2024-09-17T04:34:53.081719+0000","last_became_active":"2024-09-17T04:34:52.066263+0000","last_became_peered":"2024-09-17T04:34:52.066263+0000","last_unstale":"2024-09-17T04:34:53.081719+0000","last_undegraded":"2024-09-17T04:34:53.081719+0000","last_fullsized":"2024-09-17T04:34:53.081719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:13.396220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.068696+0000","last_change":"2024-09-17T04:34:51.067927+0000","last_active":"2024-09-17T04:34:57.068696+0000","last_peered":"2024-09-17T04:34:57.068696+0000","last_clean":"2024-09-17T04:34:57.068696+0000","last_became_active":"2024-09-17T04:34:51.067555+0000","last_became_peered":"2024-09-17T04:34:51.067555+0000","last_unstale":"2024-09-17T04:34:57.068696+0000","last_undegraded":"2024-09-17T04:34:57.068696+0000","last_fullsized":"2024-09-17T04:34:57.068696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:33.815585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081560+0000","last_change":"2024-09-17T04:34:52.074529+0000","last_active":"2024-09-17T04:34:53.081560+0000","last_peered":"2024-09-17T04:34:53.081560+0000","last_clean":"2024-09-17T04:34:53.081560+0000","last_became_active":"2024-09-17T04:34:52.074149+0000","last_became_peered":"2024-09-17T04:34:52.074149+0000","last_unstale":"2024-09-17T04:34:53.081560+0000","last_undegraded":"2024-09-17T04:34:53.081560+0000","last_fullsized":"2024-09-17T04:34:53.081560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:31.679908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.069324+0000","last_change":"2024-09-17T04:34:51.078231+0000","last_active":"2024-09-17T04:34:57.069324+0000","last_peered":"2024-09-17T04:34:57.069324+0000","last_clean":"2024-09-17T04:34:57.069324+0000","last_became_active":"2024-09-17T04:34:51.077872+0000","last_became_peered":"2024-09-17T04:34:51.077872+0000","last_unstale":"2024-09-17T04:34:57.069324+0000","last_undegraded":"2024-09-17T04:34:57.069324+0000","last_fullsized":"2024-09-17T04:34:57.069324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:38.304333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315510+0000","last_change":"2024-09-17T04:34:52.084955+0000","last_active":"2024-09-17T04:34:53.315510+0000","last_peered":"2024-09-17T04:34:53.315510+0000","last_clean":"2024-09-17T04:34:53.315510+0000","last_became_active":"2024-09-17T04:34:52.084559+0000","last_became_peered":"2024-09-17T04:34:52.084559+0000","last_unstale":"2024-09-17T04:34:53.315510+0000","last_undegraded":"2024-09-17T04:34:53.315510+0000","last_fullsized":"2024-09-17T04:34:53.315510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:28.901357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:54.611168+0000","last_change":"2024-09-17T04:34:51.073959+0000","last_active":"2024-09-17T04:34:54.611168+0000","last_peered":"2024-09-17T04:34:54.611168+0000","last_clean":"2024-09-17T04:34:54.611168+0000","last_became_active":"2024-09-17T04:34:51.073496+0000","last_became_peered":"2024-09-17T04:34:51.073496+0000","last_unstale":"2024-09-17T04:34:54.611168+0000","last_undegraded":"2024-09-17T04:34:54.611168+0000","last_fullsized":"2024-09-17T04:34:54.611168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:23.001571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177328+0000","last_change":"2024-09-17T04:34:52.081971+0000","last_active":"2024-09-17T04:34:53.177328+0000","last_peered":"2024-09-17T04:34:53.177328+0000","last_clean":"2024-09-17T04:34:53.177328+0000","last_became_active":"2024-09-17T04:34:52.081259+0000","last_became_peered":"2024-09-17T04:34:52.081259+0000","last_unstale":"2024-09-17T04:34:53.177328+0000","last_undegraded":"2024-09-17T04:34:53.177328+0000","last_fullsized":"2024-09-17T04:34:53.177328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:43.915741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.069743+0000","last_change":"2024-09-17T04:34:51.070142+0000","last_active":"2024-09-17T04:34:57.069743+0000","last_peered":"2024-09-17T04:34:57.069743+0000","last_clean":"2024-09-17T04:34:57.069743+0000","last_became_active":"2024-09-17T04:34:51.069777+0000","last_became_peered":"2024-09-17T04:34:51.069777+0000","last_unstale":"2024-09-17T04:34:57.069743+0000","last_undegraded":"2024-09-17T04:34:57.069743+0000","last_fullsized":"2024-09-17T04:34:57.069743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:51.718064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476744,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":667496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476744,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":78158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476744,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":76636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476744,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":76672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":229376,"data_stored":78158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":76546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":76706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":823296,"data_stored":667552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:35:03.132 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:35:03.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.286+0000 7f9dd5f2b640 1 -- 172.21.15.43:0/138230761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dd00c2f40 msgr2=0x7f9dd01525b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:03.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.286+0000 7f9dd5f2b640 1 --2- 172.21.15.43:0/138230761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dd00c2f40 0x7f9dd01525b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00ca690 tx=0x7f9dc002a920 comp rx=0 tx=0).stop 2024-09-17T04:35:03.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.286+0000 7f9dd5f2b640 1 -- 172.21.15.43:0/138230761 shutdown_connections 2024-09-17T04:35:03.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.286+0000 7f9dd5f2b640 1 --2- 172.21.15.43:0/138230761 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dd01589e0 0x7f9dd0158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.286+0000 7f9dd5f2b640 1 --2- 172.21.15.43:0/138230761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dd00c2f40 0x7f9dd01525b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.286+0000 7f9dd5f2b640 1 -- 172.21.15.43:0/138230761 >> 172.21.15.43:0/138230761 conn(0x7f9dd00738e0 msgr2=0x7f9dd0073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:03.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.286+0000 7f9dd5f2b640 1 -- 172.21.15.43:0/138230761 shutdown_connections 2024-09-17T04:35:03.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.286+0000 7f9dd5f2b640 1 -- 172.21.15.43:0/138230761 wait complete. 2024-09-17T04:35:03.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.287+0000 7f9dd5f2b640 1 Processor -- start 2024-09-17T04:35:03.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.288+0000 7f9dd5f2b640 1 -- start start 2024-09-17T04:35:03.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.289+0000 7f9dd5f2b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dd006e8a0 0x7f9dd014b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:03.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.289+0000 7f9dd5f2b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9dd00c2f40 0x7f9dd01e3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:03.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.289+0000 7f9dd5f2b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dd01589e0 0x7f9dd014dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:03.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.289+0000 7f9dd5f2b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd0159330 con 0x7f9dd00c2f40 2024-09-17T04:35:03.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.289+0000 7f9dd5f2b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd0070c00 con 0x7f9dd006e8a0 2024-09-17T04:35:03.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.289+0000 7f9dd5f2b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd00b41e0 con 0x7f9dd01589e0 2024-09-17T04:35:03.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.289+0000 7f9dceffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9dd00c2f40 0x7f9dd01e3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:03.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.289+0000 7f9dcffff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dd01589e0 0x7f9dd014dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:03.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.289+0000 7f9dceffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9dd00c2f40 0x7f9dd01e3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35522/0 (socket says 172.21.15.43:35522) 2024-09-17T04:35:03.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.289+0000 7f9dcf7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dd006e8a0 0x7f9dd014b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:03.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.289+0000 7f9dceffd640 1 -- 172.21.15.43:0/4036840725 learned_addr learned my addr 172.21.15.43:0/4036840725 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:03.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.289+0000 7f9dceffd640 1 -- 172.21.15.43:0/4036840725 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dd01589e0 msgr2=0x7f9dd014dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:03.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.289+0000 7f9dceffd640 1 --2- 172.21.15.43:0/4036840725 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dd01589e0 0x7f9dd014dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.289+0000 7f9dceffd640 1 -- 172.21.15.43:0/4036840725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dd006e8a0 msgr2=0x7f9dd014b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:03.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.289+0000 7f9dceffd640 1 --2- 172.21.15.43:0/4036840725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dd006e8a0 0x7f9dd014b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.289+0000 7f9dceffd640 1 -- 172.21.15.43:0/4036840725 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd014b960 con 0x7f9dd00c2f40 2024-09-17T04:35:03.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.289+0000 7f9dceffd640 1 --2- 172.21.15.43:0/4036840725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9dd00c2f40 0x7f9dd01e3460 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9db800c460 tx=0x7f9db800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:03.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.290+0000 7f9dc7fff640 1 -- 172.21.15.43:0/4036840725 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db8011790 con 0x7f9dd00c2f40 2024-09-17T04:35:03.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.290+0000 7f9dc7fff640 1 -- 172.21.15.43:0/4036840725 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9db8017070 con 0x7f9dd00c2f40 2024-09-17T04:35:03.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.290+0000 7f9dd5f2b640 1 -- 172.21.15.43:0/4036840725 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd014a6a0 con 0x7f9dd00c2f40 2024-09-17T04:35:03.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.290+0000 7f9dc7fff640 1 -- 172.21.15.43:0/4036840725 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db8011ce0 con 0x7f9dd00c2f40 2024-09-17T04:35:03.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.290+0000 7f9dd5f2b640 1 -- 172.21.15.43:0/4036840725 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd014ac20 con 0x7f9dd00c2f40 2024-09-17T04:35:03.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.291+0000 7f9dd5f2b640 1 -- 172.21.15.43:0/4036840725 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd01525b0 con 0x7f9dd00c2f40 2024-09-17T04:35:03.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.292+0000 7f9dc7fff640 1 -- 172.21.15.43:0/4036840725 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9db801c460 con 0x7f9dd00c2f40 2024-09-17T04:35:03.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.292+0000 7f9dc7fff640 1 --2- 172.21.15.43:0/4036840725 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9db0078b90 0x7f9db007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:03.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.292+0000 7f9dc7fff640 1 -- 172.21.15.43:0/4036840725 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9db809aa10 con 0x7f9dd00c2f40 2024-09-17T04:35:03.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.292+0000 7f9dcf7fe640 1 --2- 172.21.15.43:0/4036840725 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9db0078b90 0x7f9db007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:03.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.293+0000 7f9dcf7fe640 1 --2- 172.21.15.43:0/4036840725 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9db0078b90 0x7f9db007b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0034000 tx=0x7f9dc0004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:03.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.297+0000 7f9dc7fff640 1 -- 172.21.15.43:0/4036840725 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9db8062e60 con 0x7f9dd00c2f40 2024-09-17T04:35:03.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.477+0000 7f9dd5f2b640 1 -- 172.21.15.43:0/4036840725 --> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9dd00c3b70 con 0x7f9db0078b90 2024-09-17T04:35:03.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.482+0000 7f9dc7fff640 1 -- 172.21.15.43:0/4036840725 <== mgr.4100 v2:172.21.15.62:6800/1186143747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7f9dc0003970 con 0x7f9db0078b90 2024-09-17T04:35:03.484 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:35:03.485 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-17T04:35:03.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.485+0000 7f9dd5f2b640 1 -- 172.21.15.43:0/4036840725 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9db0078b90 msgr2=0x7f9db007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:03.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.485+0000 7f9dd5f2b640 1 --2- 172.21.15.43:0/4036840725 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9db0078b90 0x7f9db007b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0034000 tx=0x7f9dc0004ab0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.485+0000 7f9dd5f2b640 1 -- 172.21.15.43:0/4036840725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9dd00c2f40 msgr2=0x7f9dd01e3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:03.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.485+0000 7f9dd5f2b640 1 --2- 172.21.15.43:0/4036840725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9dd00c2f40 0x7f9dd01e3460 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9db800c460 tx=0x7f9db800c860 comp rx=0 tx=0).stop 2024-09-17T04:35:03.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.485+0000 7f9dd5f2b640 1 -- 172.21.15.43:0/4036840725 shutdown_connections 2024-09-17T04:35:03.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.485+0000 7f9dd5f2b640 1 --2- 172.21.15.43:0/4036840725 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9db0078b90 0x7f9db007b0a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.485+0000 7f9dd5f2b640 1 --2- 172.21.15.43:0/4036840725 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dd01589e0 0x7f9dd014dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.485+0000 7f9dd5f2b640 1 --2- 172.21.15.43:0/4036840725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9dd00c2f40 0x7f9dd01e3460 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.485+0000 7f9dd5f2b640 1 --2- 172.21.15.43:0/4036840725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dd006e8a0 0x7f9dd014b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.485+0000 7f9dd5f2b640 1 -- 172.21.15.43:0/4036840725 >> 172.21.15.43:0/4036840725 conn(0x7f9dd00738e0 msgr2=0x7f9dd0148aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:03.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.485+0000 7f9dd5f2b640 1 -- 172.21.15.43:0/4036840725 shutdown_connections 2024-09-17T04:35:03.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.485+0000 7f9dd5f2b640 1 -- 172.21.15.43:0/4036840725 wait complete. 2024-09-17T04:35:03.496 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-17T04:35:02.892257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239912,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734808,"statfs":{"total":773094113280,"available":772848443392,"internally_reserved":0,"allocated":2990080,"data_stored":1797924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002726"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079958+0000","last_change":"2024-09-17T04:34:52.082794+0000","last_active":"2024-09-17T04:34:53.079958+0000","last_peered":"2024-09-17T04:34:53.079958+0000","last_clean":"2024-09-17T04:34:53.079958+0000","last_became_active":"2024-09-17T04:34:52.081216+0000","last_became_peered":"2024-09-17T04:34:52.081216+0000","last_unstale":"2024-09-17T04:34:53.079958+0000","last_undegraded":"2024-09-17T04:34:53.079958+0000","last_fullsized":"2024-09-17T04:34:53.079958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:32.229667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075998+0000","last_change":"2024-09-17T04:34:52.071762+0000","last_active":"2024-09-17T04:34:53.075998+0000","last_peered":"2024-09-17T04:34:53.075998+0000","last_clean":"2024-09-17T04:34:53.075998+0000","last_became_active":"2024-09-17T04:34:52.071488+0000","last_became_peered":"2024-09-17T04:34:52.071488+0000","last_unstale":"2024-09-17T04:34:53.075998+0000","last_undegraded":"2024-09-17T04:34:53.075998+0000","last_fullsized":"2024-09-17T04:34:53.075998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:00.729921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315645+0000","last_change":"2024-09-17T04:34:52.073360+0000","last_active":"2024-09-17T04:34:53.315645+0000","last_peered":"2024-09-17T04:34:53.315645+0000","last_clean":"2024-09-17T04:34:53.315645+0000","last_became_active":"2024-09-17T04:34:52.073014+0000","last_became_peered":"2024-09-17T04:34:52.073014+0000","last_unstale":"2024-09-17T04:34:53.315645+0000","last_undegraded":"2024-09-17T04:34:53.315645+0000","last_fullsized":"2024-09-17T04:34:53.315645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:14.331608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081622+0000","last_change":"2024-09-17T04:34:52.077679+0000","last_active":"2024-09-17T04:34:53.081622+0000","last_peered":"2024-09-17T04:34:53.081622+0000","last_clean":"2024-09-17T04:34:53.081622+0000","last_became_active":"2024-09-17T04:34:52.077306+0000","last_became_peered":"2024-09-17T04:34:52.077306+0000","last_unstale":"2024-09-17T04:34:53.081622+0000","last_undegraded":"2024-09-17T04:34:53.081622+0000","last_fullsized":"2024-09-17T04:34:53.081622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:44.967159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080748+0000","last_change":"2024-09-17T04:34:52.075036+0000","last_active":"2024-09-17T04:34:53.080748+0000","last_peered":"2024-09-17T04:34:53.080748+0000","last_clean":"2024-09-17T04:34:53.080748+0000","last_became_active":"2024-09-17T04:34:52.074649+0000","last_became_peered":"2024-09-17T04:34:52.074649+0000","last_unstale":"2024-09-17T04:34:53.080748+0000","last_undegraded":"2024-09-17T04:34:53.080748+0000","last_fullsized":"2024-09-17T04:34:53.080748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:22.293746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081410+0000","last_change":"2024-09-17T04:34:52.081059+0000","last_active":"2024-09-17T04:34:53.081410+0000","last_peered":"2024-09-17T04:34:53.081410+0000","last_clean":"2024-09-17T04:34:53.081410+0000","last_became_active":"2024-09-17T04:34:52.080677+0000","last_became_peered":"2024-09-17T04:34:52.080677+0000","last_unstale":"2024-09-17T04:34:53.081410+0000","last_undegraded":"2024-09-17T04:34:53.081410+0000","last_fullsized":"2024-09-17T04:34:53.081410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:52.404672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079328+0000","last_change":"2024-09-17T04:34:52.071135+0000","last_active":"2024-09-17T04:34:53.079328+0000","last_peered":"2024-09-17T04:34:53.079328+0000","last_clean":"2024-09-17T04:34:53.079328+0000","last_became_active":"2024-09-17T04:34:52.070844+0000","last_became_peered":"2024-09-17T04:34:52.070844+0000","last_unstale":"2024-09-17T04:34:53.079328+0000","last_undegraded":"2024-09-17T04:34:53.079328+0000","last_fullsized":"2024-09-17T04:34:53.079328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:02.373675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176836+0000","last_change":"2024-09-17T04:34:52.083343+0000","last_active":"2024-09-17T04:34:53.176836+0000","last_peered":"2024-09-17T04:34:53.176836+0000","last_clean":"2024-09-17T04:34:53.176836+0000","last_became_active":"2024-09-17T04:34:52.083008+0000","last_became_peered":"2024-09-17T04:34:52.083008+0000","last_unstale":"2024-09-17T04:34:53.176836+0000","last_undegraded":"2024-09-17T04:34:53.176836+0000","last_fullsized":"2024-09-17T04:34:53.176836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:02.710077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079639+0000","last_change":"2024-09-17T04:34:52.083331+0000","last_active":"2024-09-17T04:34:53.079639+0000","last_peered":"2024-09-17T04:34:53.079639+0000","last_clean":"2024-09-17T04:34:53.079639+0000","last_became_active":"2024-09-17T04:34:52.082984+0000","last_became_peered":"2024-09-17T04:34:52.082984+0000","last_unstale":"2024-09-17T04:34:53.079639+0000","last_undegraded":"2024-09-17T04:34:53.079639+0000","last_fullsized":"2024-09-17T04:34:53.079639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:56.779776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080623+0000","last_change":"2024-09-17T04:34:52.087207+0000","last_active":"2024-09-17T04:34:53.080623+0000","last_peered":"2024-09-17T04:34:53.080623+0000","last_clean":"2024-09-17T04:34:53.080623+0000","last_became_active":"2024-09-17T04:34:52.086885+0000","last_became_peered":"2024-09-17T04:34:52.086885+0000","last_unstale":"2024-09-17T04:34:53.080623+0000","last_undegraded":"2024-09-17T04:34:53.080623+0000","last_fullsized":"2024-09-17T04:34:53.080623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:52.121338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.078802+0000","last_change":"2024-09-17T04:34:52.086309+0000","last_active":"2024-09-17T04:34:53.078802+0000","last_peered":"2024-09-17T04:34:53.078802+0000","last_clean":"2024-09-17T04:34:53.078802+0000","last_became_active":"2024-09-17T04:34:52.085996+0000","last_became_peered":"2024-09-17T04:34:52.085996+0000","last_unstale":"2024-09-17T04:34:53.078802+0000","last_undegraded":"2024-09-17T04:34:53.078802+0000","last_fullsized":"2024-09-17T04:34:53.078802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:58.004980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318081+0000","last_change":"2024-09-17T04:34:52.077080+0000","last_active":"2024-09-17T04:34:53.318081+0000","last_peered":"2024-09-17T04:34:53.318081+0000","last_clean":"2024-09-17T04:34:53.318081+0000","last_became_active":"2024-09-17T04:34:52.076756+0000","last_became_peered":"2024-09-17T04:34:52.076756+0000","last_unstale":"2024-09-17T04:34:53.318081+0000","last_undegraded":"2024-09-17T04:34:53.318081+0000","last_fullsized":"2024-09-17T04:34:53.318081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:48.044400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177180+0000","last_change":"2024-09-17T04:34:52.076609+0000","last_active":"2024-09-17T04:34:53.177180+0000","last_peered":"2024-09-17T04:34:53.177180+0000","last_clean":"2024-09-17T04:34:53.177180+0000","last_became_active":"2024-09-17T04:34:52.076277+0000","last_became_peered":"2024-09-17T04:34:52.076277+0000","last_unstale":"2024-09-17T04:34:53.177180+0000","last_undegraded":"2024-09-17T04:34:53.177180+0000","last_fullsized":"2024-09-17T04:34:53.177180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:28.537566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315331+0000","last_change":"2024-09-17T04:34:52.076754+0000","last_active":"2024-09-17T04:34:53.315331+0000","last_peered":"2024-09-17T04:34:53.315331+0000","last_clean":"2024-09-17T04:34:53.315331+0000","last_became_active":"2024-09-17T04:34:52.076261+0000","last_became_peered":"2024-09-17T04:34:52.076261+0000","last_unstale":"2024-09-17T04:34:53.315331+0000","last_undegraded":"2024-09-17T04:34:53.315331+0000","last_fullsized":"2024-09-17T04:34:53.315331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:51.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075849+0000","last_change":"2024-09-17T04:34:52.079161+0000","last_active":"2024-09-17T04:34:53.075849+0000","last_peered":"2024-09-17T04:34:53.075849+0000","last_clean":"2024-09-17T04:34:53.075849+0000","last_became_active":"2024-09-17T04:34:52.078782+0000","last_became_peered":"2024-09-17T04:34:52.078782+0000","last_unstale":"2024-09-17T04:34:53.075849+0000","last_undegraded":"2024-09-17T04:34:53.075849+0000","last_fullsized":"2024-09-17T04:34:53.075849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:06.894137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080646+0000","last_change":"2024-09-17T04:34:52.070767+0000","last_active":"2024-09-17T04:34:53.080646+0000","last_peered":"2024-09-17T04:34:53.080646+0000","last_clean":"2024-09-17T04:34:53.080646+0000","last_became_active":"2024-09-17T04:34:52.070428+0000","last_became_peered":"2024-09-17T04:34:52.070428+0000","last_unstale":"2024-09-17T04:34:53.080646+0000","last_undegraded":"2024-09-17T04:34:53.080646+0000","last_fullsized":"2024-09-17T04:34:53.080646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:42.820391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.082014+0000","last_change":"2024-09-17T04:34:52.077238+0000","last_active":"2024-09-17T04:34:53.082014+0000","last_peered":"2024-09-17T04:34:53.082014+0000","last_clean":"2024-09-17T04:34:53.082014+0000","last_became_active":"2024-09-17T04:34:52.076897+0000","last_became_peered":"2024-09-17T04:34:52.076897+0000","last_unstale":"2024-09-17T04:34:53.082014+0000","last_undegraded":"2024-09-17T04:34:53.082014+0000","last_fullsized":"2024-09-17T04:34:53.082014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:27.431184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.316114+0000","last_change":"2024-09-17T04:34:52.080917+0000","last_active":"2024-09-17T04:34:53.316114+0000","last_peered":"2024-09-17T04:34:53.316114+0000","last_clean":"2024-09-17T04:34:53.316114+0000","last_became_active":"2024-09-17T04:34:52.080597+0000","last_became_peered":"2024-09-17T04:34:52.080597+0000","last_unstale":"2024-09-17T04:34:53.316114+0000","last_undegraded":"2024-09-17T04:34:53.316114+0000","last_fullsized":"2024-09-17T04:34:53.316114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:10.560075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080159+0000","last_change":"2024-09-17T04:34:52.077284+0000","last_active":"2024-09-17T04:34:53.080159+0000","last_peered":"2024-09-17T04:34:53.080159+0000","last_clean":"2024-09-17T04:34:53.080159+0000","last_became_active":"2024-09-17T04:34:52.076950+0000","last_became_peered":"2024-09-17T04:34:52.076950+0000","last_unstale":"2024-09-17T04:34:53.080159+0000","last_undegraded":"2024-09-17T04:34:53.080159+0000","last_fullsized":"2024-09-17T04:34:53.080159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:06.361530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079837+0000","last_change":"2024-09-17T04:34:52.083859+0000","last_active":"2024-09-17T04:34:53.079837+0000","last_peered":"2024-09-17T04:34:53.079837+0000","last_clean":"2024-09-17T04:34:53.079837+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:34:53.079837+0000","last_undegraded":"2024-09-17T04:34:53.079837+0000","last_fullsized":"2024-09-17T04:34:53.079837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:25.262925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315556+0000","last_change":"2024-09-17T04:34:52.086460+0000","last_active":"2024-09-17T04:34:53.315556+0000","last_peered":"2024-09-17T04:34:53.315556+0000","last_clean":"2024-09-17T04:34:53.315556+0000","last_became_active":"2024-09-17T04:34:52.084848+0000","last_became_peered":"2024-09-17T04:34:52.084848+0000","last_unstale":"2024-09-17T04:34:53.315556+0000","last_undegraded":"2024-09-17T04:34:53.315556+0000","last_fullsized":"2024-09-17T04:34:53.315556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:22.927331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081424+0000","last_change":"2024-09-17T04:34:52.080149+0000","last_active":"2024-09-17T04:34:53.081424+0000","last_peered":"2024-09-17T04:34:53.081424+0000","last_clean":"2024-09-17T04:34:53.081424+0000","last_became_active":"2024-09-17T04:34:52.079490+0000","last_became_peered":"2024-09-17T04:34:52.079490+0000","last_unstale":"2024-09-17T04:34:53.081424+0000","last_undegraded":"2024-09-17T04:34:53.081424+0000","last_fullsized":"2024-09-17T04:34:53.081424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:52.314715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176860+0000","last_change":"2024-09-17T04:34:52.082765+0000","last_active":"2024-09-17T04:34:53.176860+0000","last_peered":"2024-09-17T04:34:53.176860+0000","last_clean":"2024-09-17T04:34:53.176860+0000","last_became_active":"2024-09-17T04:34:52.081049+0000","last_became_peered":"2024-09-17T04:34:52.081049+0000","last_unstale":"2024-09-17T04:34:53.176860+0000","last_undegraded":"2024-09-17T04:34:53.176860+0000","last_fullsized":"2024-09-17T04:34:53.176860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.762553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081112+0000","last_change":"2024-09-17T04:34:52.086233+0000","last_active":"2024-09-17T04:34:53.081112+0000","last_peered":"2024-09-17T04:34:53.081112+0000","last_clean":"2024-09-17T04:34:53.081112+0000","last_became_active":"2024-09-17T04:34:52.085876+0000","last_became_peered":"2024-09-17T04:34:52.085876+0000","last_unstale":"2024-09-17T04:34:53.081112+0000","last_undegraded":"2024-09-17T04:34:53.081112+0000","last_fullsized":"2024-09-17T04:34:53.081112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:44.061677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177349+0000","last_change":"2024-09-17T04:34:52.079305+0000","last_active":"2024-09-17T04:34:53.177349+0000","last_peered":"2024-09-17T04:34:53.177349+0000","last_clean":"2024-09-17T04:34:53.177349+0000","last_became_active":"2024-09-17T04:34:52.078984+0000","last_became_peered":"2024-09-17T04:34:52.078984+0000","last_unstale":"2024-09-17T04:34:53.177349+0000","last_undegraded":"2024-09-17T04:34:53.177349+0000","last_fullsized":"2024-09-17T04:34:53.177349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:15.927488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080877+0000","last_change":"2024-09-17T04:34:52.077495+0000","last_active":"2024-09-17T04:34:53.080877+0000","last_peered":"2024-09-17T04:34:53.080877+0000","last_clean":"2024-09-17T04:34:53.080877+0000","last_became_active":"2024-09-17T04:34:52.077167+0000","last_became_peered":"2024-09-17T04:34:52.077167+0000","last_unstale":"2024-09-17T04:34:53.080877+0000","last_undegraded":"2024-09-17T04:34:53.080877+0000","last_fullsized":"2024-09-17T04:34:53.080877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.411611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076209+0000","last_change":"2024-09-17T04:34:52.077389+0000","last_active":"2024-09-17T04:34:53.076209+0000","last_peered":"2024-09-17T04:34:53.076209+0000","last_clean":"2024-09-17T04:34:53.076209+0000","last_became_active":"2024-09-17T04:34:52.076993+0000","last_became_peered":"2024-09-17T04:34:52.076993+0000","last_unstale":"2024-09-17T04:34:53.076209+0000","last_undegraded":"2024-09-17T04:34:53.076209+0000","last_fullsized":"2024-09-17T04:34:53.076209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:18.540098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177228+0000","last_change":"2024-09-17T04:34:52.080545+0000","last_active":"2024-09-17T04:34:53.177228+0000","last_peered":"2024-09-17T04:34:53.177228+0000","last_clean":"2024-09-17T04:34:53.177228+0000","last_became_active":"2024-09-17T04:34:52.079930+0000","last_became_peered":"2024-09-17T04:34:52.079930+0000","last_unstale":"2024-09-17T04:34:53.177228+0000","last_undegraded":"2024-09-17T04:34:53.177228+0000","last_fullsized":"2024-09-17T04:34:53.177228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:50.491050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315714+0000","last_change":"2024-09-17T04:34:52.083598+0000","last_active":"2024-09-17T04:34:53.315714+0000","last_peered":"2024-09-17T04:34:53.315714+0000","last_clean":"2024-09-17T04:34:53.315714+0000","last_became_active":"2024-09-17T04:34:52.083225+0000","last_became_peered":"2024-09-17T04:34:52.083225+0000","last_unstale":"2024-09-17T04:34:53.315714+0000","last_undegraded":"2024-09-17T04:34:53.315714+0000","last_fullsized":"2024-09-17T04:34:53.315714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:22.713546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081731+0000","last_change":"2024-09-17T04:34:52.078977+0000","last_active":"2024-09-17T04:34:53.081731+0000","last_peered":"2024-09-17T04:34:53.081731+0000","last_clean":"2024-09-17T04:34:53.081731+0000","last_became_active":"2024-09-17T04:34:52.078636+0000","last_became_peered":"2024-09-17T04:34:52.078636+0000","last_unstale":"2024-09-17T04:34:53.081731+0000","last_undegraded":"2024-09-17T04:34:53.081731+0000","last_fullsized":"2024-09-17T04:34:53.081731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:30.144564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315840+0000","last_change":"2024-09-17T04:34:52.082113+0000","last_active":"2024-09-17T04:34:53.315840+0000","last_peered":"2024-09-17T04:34:53.315840+0000","last_clean":"2024-09-17T04:34:53.315840+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:34:53.315840+0000","last_undegraded":"2024-09-17T04:34:53.315840+0000","last_fullsized":"2024-09-17T04:34:53.315840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:52.744564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.078708+0000","last_change":"2024-09-17T04:34:52.083306+0000","last_active":"2024-09-17T04:34:53.078708+0000","last_peered":"2024-09-17T04:34:53.078708+0000","last_clean":"2024-09-17T04:34:53.078708+0000","last_became_active":"2024-09-17T04:34:52.082590+0000","last_became_peered":"2024-09-17T04:34:52.082590+0000","last_unstale":"2024-09-17T04:34:53.078708+0000","last_undegraded":"2024-09-17T04:34:53.078708+0000","last_fullsized":"2024-09-17T04:34:53.078708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:21.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.317989+0000","last_change":"2024-09-17T04:34:52.070155+0000","last_active":"2024-09-17T04:34:53.317989+0000","last_peered":"2024-09-17T04:34:53.317989+0000","last_clean":"2024-09-17T04:34:53.317989+0000","last_became_active":"2024-09-17T04:34:52.069498+0000","last_became_peered":"2024-09-17T04:34:52.069498+0000","last_unstale":"2024-09-17T04:34:53.317989+0000","last_undegraded":"2024-09-17T04:34:53.317989+0000","last_fullsized":"2024-09-17T04:34:53.317989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:24.539277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:54.611120+0000","last_change":"2024-09-17T04:34:51.074188+0000","last_active":"2024-09-17T04:34:54.611120+0000","last_peered":"2024-09-17T04:34:54.611120+0000","last_clean":"2024-09-17T04:34:54.611120+0000","last_became_active":"2024-09-17T04:34:51.073740+0000","last_became_peered":"2024-09-17T04:34:51.073740+0000","last_unstale":"2024-09-17T04:34:54.611120+0000","last_undegraded":"2024-09-17T04:34:54.611120+0000","last_fullsized":"2024-09-17T04:34:54.611120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:36.692687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315954+0000","last_change":"2024-09-17T04:34:52.081048+0000","last_active":"2024-09-17T04:34:53.315954+0000","last_peered":"2024-09-17T04:34:53.315954+0000","last_clean":"2024-09-17T04:34:53.315954+0000","last_became_active":"2024-09-17T04:34:52.080703+0000","last_became_peered":"2024-09-17T04:34:52.080703+0000","last_unstale":"2024-09-17T04:34:53.315954+0000","last_undegraded":"2024-09-17T04:34:53.315954+0000","last_fullsized":"2024-09-17T04:34:53.315954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:05.164849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079248+0000","last_change":"2024-09-17T04:34:51.078602+0000","last_active":"2024-09-17T04:34:53.079248+0000","last_peered":"2024-09-17T04:34:53.079248+0000","last_clean":"2024-09-17T04:34:53.079248+0000","last_became_active":"2024-09-17T04:34:51.078221+0000","last_became_peered":"2024-09-17T04:34:51.078221+0000","last_unstale":"2024-09-17T04:34:53.079248+0000","last_undegraded":"2024-09-17T04:34:53.079248+0000","last_fullsized":"2024-09-17T04:34:53.079248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:59.716216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176933+0000","last_change":"2024-09-17T04:34:51.077573+0000","last_active":"2024-09-17T04:34:53.176933+0000","last_peered":"2024-09-17T04:34:53.176933+0000","last_clean":"2024-09-17T04:34:53.176933+0000","last_became_active":"2024-09-17T04:34:51.077225+0000","last_became_peered":"2024-09-17T04:34:51.077225+0000","last_unstale":"2024-09-17T04:34:53.176933+0000","last_undegraded":"2024-09-17T04:34:53.176933+0000","last_fullsized":"2024-09-17T04:34:53.176933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:29.348927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176928+0000","last_change":"2024-09-17T04:34:52.074356+0000","last_active":"2024-09-17T04:34:53.176928+0000","last_peered":"2024-09-17T04:34:53.176928+0000","last_clean":"2024-09-17T04:34:53.176928+0000","last_became_active":"2024-09-17T04:34:52.072796+0000","last_became_peered":"2024-09-17T04:34:52.072796+0000","last_unstale":"2024-09-17T04:34:53.176928+0000","last_undegraded":"2024-09-17T04:34:53.176928+0000","last_fullsized":"2024-09-17T04:34:53.176928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:53.971839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081155+0000","last_change":"2024-09-17T04:34:51.074170+0000","last_active":"2024-09-17T04:34:53.081155+0000","last_peered":"2024-09-17T04:34:53.081155+0000","last_clean":"2024-09-17T04:34:53.081155+0000","last_became_active":"2024-09-17T04:34:51.073836+0000","last_became_peered":"2024-09-17T04:34:51.073836+0000","last_unstale":"2024-09-17T04:34:53.081155+0000","last_undegraded":"2024-09-17T04:34:53.081155+0000","last_fullsized":"2024-09-17T04:34:53.081155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:30.884002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075826+0000","last_change":"2024-09-17T04:34:52.078331+0000","last_active":"2024-09-17T04:34:53.075826+0000","last_peered":"2024-09-17T04:34:53.075826+0000","last_clean":"2024-09-17T04:34:53.075826+0000","last_became_active":"2024-09-17T04:34:52.078012+0000","last_became_peered":"2024-09-17T04:34:52.078012+0000","last_unstale":"2024-09-17T04:34:53.075826+0000","last_undegraded":"2024-09-17T04:34:53.075826+0000","last_fullsized":"2024-09-17T04:34:53.075826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:28.961571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.078937+0000","last_change":"2024-09-17T04:34:51.077676+0000","last_active":"2024-09-17T04:34:53.078937+0000","last_peered":"2024-09-17T04:34:53.078937+0000","last_clean":"2024-09-17T04:34:53.078937+0000","last_became_active":"2024-09-17T04:34:51.076291+0000","last_became_peered":"2024-09-17T04:34:51.076291+0000","last_unstale":"2024-09-17T04:34:53.078937+0000","last_undegraded":"2024-09-17T04:34:53.078937+0000","last_fullsized":"2024-09-17T04:34:53.078937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:42.622688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081329+0000","last_change":"2024-09-17T04:34:52.075624+0000","last_active":"2024-09-17T04:34:53.081329+0000","last_peered":"2024-09-17T04:34:53.081329+0000","last_clean":"2024-09-17T04:34:53.081329+0000","last_became_active":"2024-09-17T04:34:52.074943+0000","last_became_peered":"2024-09-17T04:34:52.074943+0000","last_unstale":"2024-09-17T04:34:53.081329+0000","last_undegraded":"2024-09-17T04:34:53.081329+0000","last_fullsized":"2024-09-17T04:34:53.081329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:56.749605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081379+0000","last_change":"2024-09-17T04:34:51.077199+0000","last_active":"2024-09-17T04:34:53.081379+0000","last_peered":"2024-09-17T04:34:53.081379+0000","last_clean":"2024-09-17T04:34:53.081379+0000","last_became_active":"2024-09-17T04:34:51.076867+0000","last_became_peered":"2024-09-17T04:34:51.076867+0000","last_unstale":"2024-09-17T04:34:53.081379+0000","last_undegraded":"2024-09-17T04:34:53.081379+0000","last_fullsized":"2024-09-17T04:34:53.081379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:09.194133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315797+0000","last_change":"2024-09-17T04:34:52.083401+0000","last_active":"2024-09-17T04:34:53.315797+0000","last_peered":"2024-09-17T04:34:53.315797+0000","last_clean":"2024-09-17T04:34:53.315797+0000","last_became_active":"2024-09-17T04:34:52.083086+0000","last_became_peered":"2024-09-17T04:34:52.083086+0000","last_unstale":"2024-09-17T04:34:53.315797+0000","last_undegraded":"2024-09-17T04:34:53.315797+0000","last_fullsized":"2024-09-17T04:34:53.315797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.237945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.070035+0000","last_change":"2024-09-17T04:34:51.070235+0000","last_active":"2024-09-17T04:34:57.070035+0000","last_peered":"2024-09-17T04:34:57.070035+0000","last_clean":"2024-09-17T04:34:57.070035+0000","last_became_active":"2024-09-17T04:34:51.069278+0000","last_became_peered":"2024-09-17T04:34:51.069278+0000","last_unstale":"2024-09-17T04:34:57.070035+0000","last_undegraded":"2024-09-17T04:34:57.070035+0000","last_fullsized":"2024-09-17T04:34:57.070035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:55.959278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318073+0000","last_change":"2024-09-17T04:34:52.076233+0000","last_active":"2024-09-17T04:34:53.318073+0000","last_peered":"2024-09-17T04:34:53.318073+0000","last_clean":"2024-09-17T04:34:53.318073+0000","last_became_active":"2024-09-17T04:34:52.075682+0000","last_became_peered":"2024-09-17T04:34:52.075682+0000","last_unstale":"2024-09-17T04:34:53.318073+0000","last_undegraded":"2024-09-17T04:34:53.318073+0000","last_fullsized":"2024-09-17T04:34:53.318073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:22.047574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.068912+0000","last_change":"2024-09-17T04:34:51.076416+0000","last_active":"2024-09-17T04:34:57.068912+0000","last_peered":"2024-09-17T04:34:57.068912+0000","last_clean":"2024-09-17T04:34:57.068912+0000","last_became_active":"2024-09-17T04:34:51.076051+0000","last_became_peered":"2024-09-17T04:34:51.076051+0000","last_unstale":"2024-09-17T04:34:57.068912+0000","last_undegraded":"2024-09-17T04:34:57.068912+0000","last_fullsized":"2024-09-17T04:34:57.068912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:52.255204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079732+0000","last_change":"2024-09-17T04:34:52.086230+0000","last_active":"2024-09-17T04:34:53.079732+0000","last_peered":"2024-09-17T04:34:53.079732+0000","last_clean":"2024-09-17T04:34:53.079732+0000","last_became_active":"2024-09-17T04:34:52.085910+0000","last_became_peered":"2024-09-17T04:34:52.085910+0000","last_unstale":"2024-09-17T04:34:53.079732+0000","last_undegraded":"2024-09-17T04:34:53.079732+0000","last_fullsized":"2024-09-17T04:34:53.079732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:36.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.063451+0000","last_change":"2024-09-17T04:34:51.075224+0000","last_active":"2024-09-17T04:34:57.063451+0000","last_peered":"2024-09-17T04:34:57.063451+0000","last_clean":"2024-09-17T04:34:57.063451+0000","last_became_active":"2024-09-17T04:34:51.074912+0000","last_became_peered":"2024-09-17T04:34:51.074912+0000","last_unstale":"2024-09-17T04:34:57.063451+0000","last_undegraded":"2024-09-17T04:34:57.063451+0000","last_fullsized":"2024-09-17T04:34:57.063451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:33.811243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315617+0000","last_change":"2024-09-17T04:34:52.085906+0000","last_active":"2024-09-17T04:34:53.315617+0000","last_peered":"2024-09-17T04:34:53.315617+0000","last_clean":"2024-09-17T04:34:53.315617+0000","last_became_active":"2024-09-17T04:34:52.085538+0000","last_became_peered":"2024-09-17T04:34:52.085538+0000","last_unstale":"2024-09-17T04:34:53.315617+0000","last_undegraded":"2024-09-17T04:34:53.315617+0000","last_fullsized":"2024-09-17T04:34:53.315617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:21.997395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081689+0000","last_change":"2024-09-17T04:34:51.074253+0000","last_active":"2024-09-17T04:34:53.081689+0000","last_peered":"2024-09-17T04:34:53.081689+0000","last_clean":"2024-09-17T04:34:53.081689+0000","last_became_active":"2024-09-17T04:34:51.073812+0000","last_became_peered":"2024-09-17T04:34:51.073812+0000","last_unstale":"2024-09-17T04:34:53.081689+0000","last_undegraded":"2024-09-17T04:34:53.081689+0000","last_fullsized":"2024-09-17T04:34:53.081689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:38.971561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081022+0000","last_change":"2024-09-17T04:34:52.082137+0000","last_active":"2024-09-17T04:34:53.081022+0000","last_peered":"2024-09-17T04:34:53.081022+0000","last_clean":"2024-09-17T04:34:53.081022+0000","last_became_active":"2024-09-17T04:34:52.081775+0000","last_became_peered":"2024-09-17T04:34:52.081775+0000","last_unstale":"2024-09-17T04:34:53.081022+0000","last_undegraded":"2024-09-17T04:34:53.081022+0000","last_fullsized":"2024-09-17T04:34:53.081022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:57.911822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080176+0000","last_change":"2024-09-17T04:34:51.077157+0000","last_active":"2024-09-17T04:34:53.080176+0000","last_peered":"2024-09-17T04:34:53.080176+0000","last_clean":"2024-09-17T04:34:53.080176+0000","last_became_active":"2024-09-17T04:34:51.076797+0000","last_became_peered":"2024-09-17T04:34:51.076797+0000","last_unstale":"2024-09-17T04:34:53.080176+0000","last_undegraded":"2024-09-17T04:34:53.080176+0000","last_fullsized":"2024-09-17T04:34:53.080176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:20.118978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079355+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:34:53.079355+0000","last_peered":"2024-09-17T04:34:53.079355+0000","last_clean":"2024-09-17T04:34:53.079355+0000","last_became_active":"2024-09-17T04:34:52.082118+0000","last_became_peered":"2024-09-17T04:34:52.082118+0000","last_unstale":"2024-09-17T04:34:53.079355+0000","last_undegraded":"2024-09-17T04:34:53.079355+0000","last_fullsized":"2024-09-17T04:34:53.079355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:44.752945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.066513+0000","last_change":"2024-09-17T04:34:51.071083+0000","last_active":"2024-09-17T04:34:57.066513+0000","last_peered":"2024-09-17T04:34:57.066513+0000","last_clean":"2024-09-17T04:34:57.066513+0000","last_became_active":"2024-09-17T04:34:51.070733+0000","last_became_peered":"2024-09-17T04:34:51.070733+0000","last_unstale":"2024-09-17T04:34:57.066513+0000","last_undegraded":"2024-09-17T04:34:57.066513+0000","last_fullsized":"2024-09-17T04:34:57.066513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:36.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079638+0000","last_change":"2024-09-17T04:34:52.080277+0000","last_active":"2024-09-17T04:34:53.079638+0000","last_peered":"2024-09-17T04:34:53.079638+0000","last_clean":"2024-09-17T04:34:53.079638+0000","last_became_active":"2024-09-17T04:34:52.079969+0000","last_became_peered":"2024-09-17T04:34:52.079969+0000","last_unstale":"2024-09-17T04:34:53.079638+0000","last_undegraded":"2024-09-17T04:34:53.079638+0000","last_fullsized":"2024-09-17T04:34:53.079638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:10.360905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318183+0000","last_change":"2024-09-17T04:34:51.074800+0000","last_active":"2024-09-17T04:34:53.318183+0000","last_peered":"2024-09-17T04:34:53.318183+0000","last_clean":"2024-09-17T04:34:53.318183+0000","last_became_active":"2024-09-17T04:34:51.073287+0000","last_became_peered":"2024-09-17T04:34:51.073287+0000","last_unstale":"2024-09-17T04:34:53.318183+0000","last_undegraded":"2024-09-17T04:34:53.318183+0000","last_fullsized":"2024-09-17T04:34:53.318183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:19.933857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079619+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:34:53.079619+0000","last_peered":"2024-09-17T04:34:53.079619+0000","last_clean":"2024-09-17T04:34:53.079619+0000","last_became_active":"2024-09-17T04:34:52.082607+0000","last_became_peered":"2024-09-17T04:34:52.082607+0000","last_unstale":"2024-09-17T04:34:53.079619+0000","last_undegraded":"2024-09-17T04:34:53.079619+0000","last_fullsized":"2024-09-17T04:34:53.079619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:08.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.064837+0000","last_change":"2024-09-17T04:34:51.077171+0000","last_active":"2024-09-17T04:34:57.064837+0000","last_peered":"2024-09-17T04:34:57.064837+0000","last_clean":"2024-09-17T04:34:57.064837+0000","last_became_active":"2024-09-17T04:34:51.076780+0000","last_became_peered":"2024-09-17T04:34:51.076780+0000","last_unstale":"2024-09-17T04:34:57.064837+0000","last_undegraded":"2024-09-17T04:34:57.064837+0000","last_fullsized":"2024-09-17T04:34:57.064837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:40.031852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079942+0000","last_change":"2024-09-17T04:34:52.080032+0000","last_active":"2024-09-17T04:34:53.079942+0000","last_peered":"2024-09-17T04:34:53.079942+0000","last_clean":"2024-09-17T04:34:53.079942+0000","last_became_active":"2024-09-17T04:34:52.079536+0000","last_became_peered":"2024-09-17T04:34:52.079536+0000","last_unstale":"2024-09-17T04:34:53.079942+0000","last_undegraded":"2024-09-17T04:34:53.079942+0000","last_fullsized":"2024-09-17T04:34:53.079942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:55.220027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:54.608800+0000","last_change":"2024-09-17T04:34:51.071053+0000","last_active":"2024-09-17T04:34:54.608800+0000","last_peered":"2024-09-17T04:34:54.608800+0000","last_clean":"2024-09-17T04:34:54.608800+0000","last_became_active":"2024-09-17T04:34:51.070673+0000","last_became_peered":"2024-09-17T04:34:51.070673+0000","last_unstale":"2024-09-17T04:34:54.608800+0000","last_undegraded":"2024-09-17T04:34:54.608800+0000","last_fullsized":"2024-09-17T04:34:54.608800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:31.660200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081894+0000","last_change":"2024-09-17T04:34:52.077963+0000","last_active":"2024-09-17T04:34:53.081894+0000","last_peered":"2024-09-17T04:34:53.081894+0000","last_clean":"2024-09-17T04:34:53.081894+0000","last_became_active":"2024-09-17T04:34:52.077499+0000","last_became_peered":"2024-09-17T04:34:52.077499+0000","last_unstale":"2024-09-17T04:34:53.081894+0000","last_undegraded":"2024-09-17T04:34:53.081894+0000","last_fullsized":"2024-09-17T04:34:53.081894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:25.309696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.316030+0000","last_change":"2024-09-17T04:34:51.070532+0000","last_active":"2024-09-17T04:34:53.316030+0000","last_peered":"2024-09-17T04:34:53.316030+0000","last_clean":"2024-09-17T04:34:53.316030+0000","last_became_active":"2024-09-17T04:34:51.070179+0000","last_became_peered":"2024-09-17T04:34:51.070179+0000","last_unstale":"2024-09-17T04:34:53.316030+0000","last_undegraded":"2024-09-17T04:34:53.316030+0000","last_fullsized":"2024-09-17T04:34:53.316030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:52.027096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079935+0000","last_change":"2024-09-17T04:34:52.083159+0000","last_active":"2024-09-17T04:34:53.079935+0000","last_peered":"2024-09-17T04:34:53.079935+0000","last_clean":"2024-09-17T04:34:53.079935+0000","last_became_active":"2024-09-17T04:34:52.082847+0000","last_became_peered":"2024-09-17T04:34:52.082847+0000","last_unstale":"2024-09-17T04:34:53.079935+0000","last_undegraded":"2024-09-17T04:34:53.079935+0000","last_fullsized":"2024-09-17T04:34:53.079935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:25.210506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080417+0000","last_change":"2024-09-17T04:34:41.975789+0000","last_active":"2024-09-17T04:34:53.080417+0000","last_peered":"2024-09-17T04:34:53.080417+0000","last_clean":"2024-09-17T04:34:53.080417+0000","last_became_active":"2024-09-17T04:34:41.974664+0000","last_became_peered":"2024-09-17T04:34:41.974664+0000","last_unstale":"2024-09-17T04:34:53.080417+0000","last_undegraded":"2024-09-17T04:34:53.080417+0000","last_fullsized":"2024-09-17T04:34:53.080417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_clean_scrub_stamp":"2024-09-17T04:34:39.702713+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:30.302931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080987+0000","last_change":"2024-09-17T04:34:51.068782+0000","last_active":"2024-09-17T04:34:53.080987+0000","last_peered":"2024-09-17T04:34:53.080987+0000","last_clean":"2024-09-17T04:34:53.080987+0000","last_became_active":"2024-09-17T04:34:51.068375+0000","last_became_peered":"2024-09-17T04:34:51.068375+0000","last_unstale":"2024-09-17T04:34:53.080987+0000","last_undegraded":"2024-09-17T04:34:53.080987+0000","last_fullsized":"2024-09-17T04:34:53.080987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:25.307166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177343+0000","last_change":"2024-09-17T04:34:52.086768+0000","last_active":"2024-09-17T04:34:53.177343+0000","last_peered":"2024-09-17T04:34:53.177343+0000","last_clean":"2024-09-17T04:34:53.177343+0000","last_became_active":"2024-09-17T04:34:52.086415+0000","last_became_peered":"2024-09-17T04:34:52.086415+0000","last_unstale":"2024-09-17T04:34:53.177343+0000","last_undegraded":"2024-09-17T04:34:53.177343+0000","last_fullsized":"2024-09-17T04:34:53.177343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:45.527873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080288+0000","last_change":"2024-09-17T04:34:51.075655+0000","last_active":"2024-09-17T04:34:53.080288+0000","last_peered":"2024-09-17T04:34:53.080288+0000","last_clean":"2024-09-17T04:34:53.080288+0000","last_became_active":"2024-09-17T04:34:51.075313+0000","last_became_peered":"2024-09-17T04:34:51.075313+0000","last_unstale":"2024-09-17T04:34:53.080288+0000","last_undegraded":"2024-09-17T04:34:53.080288+0000","last_fullsized":"2024-09-17T04:34:53.080288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:47.853850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315306+0000","last_change":"2024-09-17T04:34:52.080065+0000","last_active":"2024-09-17T04:34:53.315306+0000","last_peered":"2024-09-17T04:34:53.315306+0000","last_clean":"2024-09-17T04:34:53.315306+0000","last_became_active":"2024-09-17T04:34:52.079672+0000","last_became_peered":"2024-09-17T04:34:52.079672+0000","last_unstale":"2024-09-17T04:34:53.315306+0000","last_undegraded":"2024-09-17T04:34:53.315306+0000","last_fullsized":"2024-09-17T04:34:53.315306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:52.040153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315786+0000","last_change":"2024-09-17T04:34:51.075960+0000","last_active":"2024-09-17T04:34:53.315786+0000","last_peered":"2024-09-17T04:34:53.315786+0000","last_clean":"2024-09-17T04:34:53.315786+0000","last_became_active":"2024-09-17T04:34:51.075561+0000","last_became_peered":"2024-09-17T04:34:51.075561+0000","last_unstale":"2024-09-17T04:34:53.315786+0000","last_undegraded":"2024-09-17T04:34:53.315786+0000","last_fullsized":"2024-09-17T04:34:53.315786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:44.834618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075859+0000","last_change":"2024-09-17T04:34:52.070068+0000","last_active":"2024-09-17T04:34:53.075859+0000","last_peered":"2024-09-17T04:34:53.075859+0000","last_clean":"2024-09-17T04:34:53.075859+0000","last_became_active":"2024-09-17T04:34:52.069669+0000","last_became_peered":"2024-09-17T04:34:52.069669+0000","last_unstale":"2024-09-17T04:34:53.075859+0000","last_undegraded":"2024-09-17T04:34:53.075859+0000","last_fullsized":"2024-09-17T04:34:53.075859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:39.617045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081829+0000","last_change":"2024-09-17T04:34:51.070187+0000","last_active":"2024-09-17T04:34:53.081829+0000","last_peered":"2024-09-17T04:34:53.081829+0000","last_clean":"2024-09-17T04:34:53.081829+0000","last_became_active":"2024-09-17T04:34:51.069714+0000","last_became_peered":"2024-09-17T04:34:51.069714+0000","last_unstale":"2024-09-17T04:34:53.081829+0000","last_undegraded":"2024-09-17T04:34:53.081829+0000","last_fullsized":"2024-09-17T04:34:53.081829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:28.082690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318145+0000","last_change":"2024-09-17T04:34:52.069653+0000","last_active":"2024-09-17T04:34:53.318145+0000","last_peered":"2024-09-17T04:34:53.318145+0000","last_clean":"2024-09-17T04:34:53.318145+0000","last_became_active":"2024-09-17T04:34:52.069282+0000","last_became_peered":"2024-09-17T04:34:52.069282+0000","last_unstale":"2024-09-17T04:34:53.318145+0000","last_undegraded":"2024-09-17T04:34:53.318145+0000","last_fullsized":"2024-09-17T04:34:53.318145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:40.828725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076208+0000","last_change":"2024-09-17T04:34:51.070676+0000","last_active":"2024-09-17T04:34:53.076208+0000","last_peered":"2024-09-17T04:34:53.076208+0000","last_clean":"2024-09-17T04:34:53.076208+0000","last_became_active":"2024-09-17T04:34:51.069006+0000","last_became_peered":"2024-09-17T04:34:51.069006+0000","last_unstale":"2024-09-17T04:34:53.076208+0000","last_undegraded":"2024-09-17T04:34:53.076208+0000","last_fullsized":"2024-09-17T04:34:53.076208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:45.452865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081804+0000","last_change":"2024-09-17T04:34:52.087131+0000","last_active":"2024-09-17T04:34:53.081804+0000","last_peered":"2024-09-17T04:34:53.081804+0000","last_clean":"2024-09-17T04:34:53.081804+0000","last_became_active":"2024-09-17T04:34:52.086782+0000","last_became_peered":"2024-09-17T04:34:52.086782+0000","last_unstale":"2024-09-17T04:34:53.081804+0000","last_undegraded":"2024-09-17T04:34:53.081804+0000","last_fullsized":"2024-09-17T04:34:53.081804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:53.987579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080352+0000","last_change":"2024-09-17T04:34:51.068708+0000","last_active":"2024-09-17T04:34:53.080352+0000","last_peered":"2024-09-17T04:34:53.080352+0000","last_clean":"2024-09-17T04:34:53.080352+0000","last_became_active":"2024-09-17T04:34:51.068354+0000","last_became_peered":"2024-09-17T04:34:51.068354+0000","last_unstale":"2024-09-17T04:34:53.080352+0000","last_undegraded":"2024-09-17T04:34:53.080352+0000","last_fullsized":"2024-09-17T04:34:53.080352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:04.219898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076122+0000","last_change":"2024-09-17T04:34:52.071586+0000","last_active":"2024-09-17T04:34:53.076122+0000","last_peered":"2024-09-17T04:34:53.076122+0000","last_clean":"2024-09-17T04:34:53.076122+0000","last_became_active":"2024-09-17T04:34:52.071246+0000","last_became_peered":"2024-09-17T04:34:52.071246+0000","last_unstale":"2024-09-17T04:34:53.076122+0000","last_undegraded":"2024-09-17T04:34:53.076122+0000","last_fullsized":"2024-09-17T04:34:53.076122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:03.620107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076048+0000","last_change":"2024-09-17T04:34:51.078947+0000","last_active":"2024-09-17T04:34:53.076048+0000","last_peered":"2024-09-17T04:34:53.076048+0000","last_clean":"2024-09-17T04:34:53.076048+0000","last_became_active":"2024-09-17T04:34:51.078557+0000","last_became_peered":"2024-09-17T04:34:51.078557+0000","last_unstale":"2024-09-17T04:34:53.076048+0000","last_undegraded":"2024-09-17T04:34:53.076048+0000","last_fullsized":"2024-09-17T04:34:53.076048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:51.413772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177384+0000","last_change":"2024-09-17T04:34:52.086372+0000","last_active":"2024-09-17T04:34:53.177384+0000","last_peered":"2024-09-17T04:34:53.177384+0000","last_clean":"2024-09-17T04:34:53.177384+0000","last_became_active":"2024-09-17T04:34:52.086018+0000","last_became_peered":"2024-09-17T04:34:52.086018+0000","last_unstale":"2024-09-17T04:34:53.177384+0000","last_undegraded":"2024-09-17T04:34:53.177384+0000","last_fullsized":"2024-09-17T04:34:53.177384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:10.818503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.068981+0000","last_change":"2024-09-17T04:34:51.076427+0000","last_active":"2024-09-17T04:34:57.068981+0000","last_peered":"2024-09-17T04:34:57.068981+0000","last_clean":"2024-09-17T04:34:57.068981+0000","last_became_active":"2024-09-17T04:34:51.075881+0000","last_became_peered":"2024-09-17T04:34:51.075881+0000","last_unstale":"2024-09-17T04:34:57.068981+0000","last_undegraded":"2024-09-17T04:34:57.068981+0000","last_fullsized":"2024-09-17T04:34:57.068981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:40.903989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315468+0000","last_change":"2024-09-17T04:34:52.076358+0000","last_active":"2024-09-17T04:34:53.315468+0000","last_peered":"2024-09-17T04:34:53.315468+0000","last_clean":"2024-09-17T04:34:53.315468+0000","last_became_active":"2024-09-17T04:34:52.076035+0000","last_became_peered":"2024-09-17T04:34:52.076035+0000","last_unstale":"2024-09-17T04:34:53.315468+0000","last_undegraded":"2024-09-17T04:34:53.315468+0000","last_fullsized":"2024-09-17T04:34:53.315468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:30.660617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080167+0000","last_change":"2024-09-17T04:34:51.072737+0000","last_active":"2024-09-17T04:34:53.080167+0000","last_peered":"2024-09-17T04:34:53.080167+0000","last_clean":"2024-09-17T04:34:53.080167+0000","last_became_active":"2024-09-17T04:34:51.072378+0000","last_became_peered":"2024-09-17T04:34:51.072378+0000","last_unstale":"2024-09-17T04:34:53.080167+0000","last_undegraded":"2024-09-17T04:34:53.080167+0000","last_fullsized":"2024-09-17T04:34:53.080167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:27.364636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318181+0000","last_change":"2024-09-17T04:34:52.068446+0000","last_active":"2024-09-17T04:34:53.318181+0000","last_peered":"2024-09-17T04:34:53.318181+0000","last_clean":"2024-09-17T04:34:53.318181+0000","last_became_active":"2024-09-17T04:34:52.068047+0000","last_became_peered":"2024-09-17T04:34:52.068047+0000","last_unstale":"2024-09-17T04:34:53.318181+0000","last_undegraded":"2024-09-17T04:34:53.318181+0000","last_fullsized":"2024-09-17T04:34:53.318181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:26.994189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075960+0000","last_change":"2024-09-17T04:34:51.069539+0000","last_active":"2024-09-17T04:34:53.075960+0000","last_peered":"2024-09-17T04:34:53.075960+0000","last_clean":"2024-09-17T04:34:53.075960+0000","last_became_active":"2024-09-17T04:34:51.067438+0000","last_became_peered":"2024-09-17T04:34:51.067438+0000","last_unstale":"2024-09-17T04:34:53.075960+0000","last_undegraded":"2024-09-17T04:34:53.075960+0000","last_fullsized":"2024-09-17T04:34:53.075960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:13.078391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177144+0000","last_change":"2024-09-17T04:34:52.078035+0000","last_active":"2024-09-17T04:34:53.177144+0000","last_peered":"2024-09-17T04:34:53.177144+0000","last_clean":"2024-09-17T04:34:53.177144+0000","last_became_active":"2024-09-17T04:34:52.077708+0000","last_became_peered":"2024-09-17T04:34:52.077708+0000","last_unstale":"2024-09-17T04:34:53.177144+0000","last_undegraded":"2024-09-17T04:34:53.177144+0000","last_fullsized":"2024-09-17T04:34:53.177144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:00.313209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076024+0000","last_change":"2024-09-17T04:34:51.074749+0000","last_active":"2024-09-17T04:34:53.076024+0000","last_peered":"2024-09-17T04:34:53.076024+0000","last_clean":"2024-09-17T04:34:53.076024+0000","last_became_active":"2024-09-17T04:34:51.074393+0000","last_became_peered":"2024-09-17T04:34:51.074393+0000","last_unstale":"2024-09-17T04:34:53.076024+0000","last_undegraded":"2024-09-17T04:34:53.076024+0000","last_fullsized":"2024-09-17T04:34:53.076024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:39.558815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177339+0000","last_change":"2024-09-17T04:34:52.075585+0000","last_active":"2024-09-17T04:34:53.177339+0000","last_peered":"2024-09-17T04:34:53.177339+0000","last_clean":"2024-09-17T04:34:53.177339+0000","last_became_active":"2024-09-17T04:34:52.075257+0000","last_became_peered":"2024-09-17T04:34:52.075257+0000","last_unstale":"2024-09-17T04:34:53.177339+0000","last_undegraded":"2024-09-17T04:34:53.177339+0000","last_fullsized":"2024-09-17T04:34:53.177339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:38.029256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.069392+0000","last_change":"2024-09-17T04:34:51.071324+0000","last_active":"2024-09-17T04:34:57.069392+0000","last_peered":"2024-09-17T04:34:57.069392+0000","last_clean":"2024-09-17T04:34:57.069392+0000","last_became_active":"2024-09-17T04:34:51.070944+0000","last_became_peered":"2024-09-17T04:34:51.070944+0000","last_unstale":"2024-09-17T04:34:57.069392+0000","last_undegraded":"2024-09-17T04:34:57.069392+0000","last_fullsized":"2024-09-17T04:34:57.069392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:13.931324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079005+0000","last_change":"2024-09-17T04:34:52.081178+0000","last_active":"2024-09-17T04:34:53.079005+0000","last_peered":"2024-09-17T04:34:53.079005+0000","last_clean":"2024-09-17T04:34:53.079005+0000","last_became_active":"2024-09-17T04:34:52.080855+0000","last_became_peered":"2024-09-17T04:34:52.080855+0000","last_unstale":"2024-09-17T04:34:53.079005+0000","last_undegraded":"2024-09-17T04:34:53.079005+0000","last_fullsized":"2024-09-17T04:34:53.079005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:49.091080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081719+0000","last_change":"2024-09-17T04:34:52.066633+0000","last_active":"2024-09-17T04:34:53.081719+0000","last_peered":"2024-09-17T04:34:53.081719+0000","last_clean":"2024-09-17T04:34:53.081719+0000","last_became_active":"2024-09-17T04:34:52.066263+0000","last_became_peered":"2024-09-17T04:34:52.066263+0000","last_unstale":"2024-09-17T04:34:53.081719+0000","last_undegraded":"2024-09-17T04:34:53.081719+0000","last_fullsized":"2024-09-17T04:34:53.081719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:13.396220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.068696+0000","last_change":"2024-09-17T04:34:51.067927+0000","last_active":"2024-09-17T04:34:57.068696+0000","last_peered":"2024-09-17T04:34:57.068696+0000","last_clean":"2024-09-17T04:34:57.068696+0000","last_became_active":"2024-09-17T04:34:51.067555+0000","last_became_peered":"2024-09-17T04:34:51.067555+0000","last_unstale":"2024-09-17T04:34:57.068696+0000","last_undegraded":"2024-09-17T04:34:57.068696+0000","last_fullsized":"2024-09-17T04:34:57.068696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:33.815585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081560+0000","last_change":"2024-09-17T04:34:52.074529+0000","last_active":"2024-09-17T04:34:53.081560+0000","last_peered":"2024-09-17T04:34:53.081560+0000","last_clean":"2024-09-17T04:34:53.081560+0000","last_became_active":"2024-09-17T04:34:52.074149+0000","last_became_peered":"2024-09-17T04:34:52.074149+0000","last_unstale":"2024-09-17T04:34:53.081560+0000","last_undegraded":"2024-09-17T04:34:53.081560+0000","last_fullsized":"2024-09-17T04:34:53.081560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:31.679908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.069324+0000","last_change":"2024-09-17T04:34:51.078231+0000","last_active":"2024-09-17T04:34:57.069324+0000","last_peered":"2024-09-17T04:34:57.069324+0000","last_clean":"2024-09-17T04:34:57.069324+0000","last_became_active":"2024-09-17T04:34:51.077872+0000","last_became_peered":"2024-09-17T04:34:51.077872+0000","last_unstale":"2024-09-17T04:34:57.069324+0000","last_undegraded":"2024-09-17T04:34:57.069324+0000","last_fullsized":"2024-09-17T04:34:57.069324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:38.304333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315510+0000","last_change":"2024-09-17T04:34:52.084955+0000","last_active":"2024-09-17T04:34:53.315510+0000","last_peered":"2024-09-17T04:34:53.315510+0000","last_clean":"2024-09-17T04:34:53.315510+0000","last_became_active":"2024-09-17T04:34:52.084559+0000","last_became_peered":"2024-09-17T04:34:52.084559+0000","last_unstale":"2024-09-17T04:34:53.315510+0000","last_undegraded":"2024-09-17T04:34:53.315510+0000","last_fullsized":"2024-09-17T04:34:53.315510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:28.901357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:54.611168+0000","last_change":"2024-09-17T04:34:51.073959+0000","last_active":"2024-09-17T04:34:54.611168+0000","last_peered":"2024-09-17T04:34:54.611168+0000","last_clean":"2024-09-17T04:34:54.611168+0000","last_became_active":"2024-09-17T04:34:51.073496+0000","last_became_peered":"2024-09-17T04:34:51.073496+0000","last_unstale":"2024-09-17T04:34:54.611168+0000","last_undegraded":"2024-09-17T04:34:54.611168+0000","last_fullsized":"2024-09-17T04:34:54.611168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:23.001571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177328+0000","last_change":"2024-09-17T04:34:52.081971+0000","last_active":"2024-09-17T04:34:53.177328+0000","last_peered":"2024-09-17T04:34:53.177328+0000","last_clean":"2024-09-17T04:34:53.177328+0000","last_became_active":"2024-09-17T04:34:52.081259+0000","last_became_peered":"2024-09-17T04:34:52.081259+0000","last_unstale":"2024-09-17T04:34:53.177328+0000","last_undegraded":"2024-09-17T04:34:53.177328+0000","last_fullsized":"2024-09-17T04:34:53.177328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:43.915741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.069743+0000","last_change":"2024-09-17T04:34:51.070142+0000","last_active":"2024-09-17T04:34:57.069743+0000","last_peered":"2024-09-17T04:34:57.069743+0000","last_clean":"2024-09-17T04:34:57.069743+0000","last_became_active":"2024-09-17T04:34:51.069777+0000","last_became_peered":"2024-09-17T04:34:51.069777+0000","last_unstale":"2024-09-17T04:34:57.069743+0000","last_undegraded":"2024-09-17T04:34:57.069743+0000","last_fullsized":"2024-09-17T04:34:57.069743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:51.718064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476744,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":667496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476744,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":78158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476744,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":76636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476744,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":76672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":229376,"data_stored":78158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":76546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":76706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":823296,"data_stored":667552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:35:03.500 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T04:35:03.500 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T04:35:03.500 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T04:35:03.500 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T04:35:03.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.654+0000 7f0c0d762640 1 -- 172.21.15.43:0/484088056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf0003a00 msgr2=0x7f0bf0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:03.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.654+0000 7f0c0d762640 1 --2- 172.21.15.43:0/484088056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf0003a00 0x7f0bf0003e70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009b50 tx=0x7f0bf0005830 comp rx=0 tx=0).stop 2024-09-17T04:35:03.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.654+0000 7f0c077fe640 1 -- 172.21.15.43:0/484088056 reap_dead start 2024-09-17T04:35:03.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.654+0000 7f0c0d762640 1 -- 172.21.15.43:0/484088056 shutdown_connections 2024-09-17T04:35:03.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.654+0000 7f0c0d762640 1 -- 172.21.15.43:0/484088056 >> 172.21.15.43:0/484088056 conn(0x7f0c080738e0 msgr2=0x7f0c08073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:03.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.654+0000 7f0c0d762640 1 -- 172.21.15.43:0/484088056 shutdown_connections 2024-09-17T04:35:03.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.654+0000 7f0c0d762640 1 -- 172.21.15.43:0/484088056 wait complete. 2024-09-17T04:35:03.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.656+0000 7f0c0d762640 1 Processor -- start 2024-09-17T04:35:03.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.656+0000 7f0c0d762640 1 -- start start 2024-09-17T04:35:03.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.657+0000 7f0c0d762640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf0003a00 0x7f0c0814ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:03.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.657+0000 7f0c0d762640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0c080b29b0 0x7f0c080cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:03.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.657+0000 7f0c0d762640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c08149130 0x7f0c08144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:03.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.657+0000 7f0c0d762640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0c08070c00 con 0x7f0bf0003a00 2024-09-17T04:35:03.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.657+0000 7f0c0d762640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0c080c3b70 con 0x7f0c08149130 2024-09-17T04:35:03.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.657+0000 7f0c0d762640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0c080b41e0 con 0x7f0c080b29b0 2024-09-17T04:35:03.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.657+0000 7f0c06ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf0003a00 0x7f0c0814ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:03.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.657+0000 7f0c06ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf0003a00 0x7f0c0814ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35540/0 (socket says 172.21.15.43:35540) 2024-09-17T04:35:03.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.657+0000 7f0c06ffd640 1 -- 172.21.15.43:0/553688548 learned_addr learned my addr 172.21.15.43:0/553688548 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:03.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.657+0000 7f0c067fc640 1 --2- 172.21.15.43:0/553688548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0c080b29b0 0x7f0c080cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:03.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.657+0000 7f0c077fe640 1 --2- 172.21.15.43:0/553688548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c08149130 0x7f0c08144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:03.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.657+0000 7f0c06ffd640 1 -- 172.21.15.43:0/553688548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0c080b29b0 msgr2=0x7f0c080cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:03.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.657+0000 7f0c06ffd640 1 --2- 172.21.15.43:0/553688548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0c080b29b0 0x7f0c080cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.657+0000 7f0c06ffd640 1 -- 172.21.15.43:0/553688548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c08149130 msgr2=0x7f0c08144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:03.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.657+0000 7f0c06ffd640 1 --2- 172.21.15.43:0/553688548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c08149130 0x7f0c08144750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.657+0000 7f0c06ffd640 1 -- 172.21.15.43:0/553688548 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c081e11a0 con 0x7f0bf0003a00 2024-09-17T04:35:03.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.658+0000 7f0c06ffd640 1 --2- 172.21.15.43:0/553688548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf0003a00 0x7f0c0814ab30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009c70 tx=0x7f0bf8033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:03.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.658+0000 7f0bef7fe640 1 -- 172.21.15.43:0/553688548 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8043070 con 0x7f0bf0003a00 2024-09-17T04:35:03.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.658+0000 7f0bef7fe640 1 -- 172.21.15.43:0/553688548 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bf8004120 con 0x7f0bf0003a00 2024-09-17T04:35:03.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.658+0000 7f0bef7fe640 1 -- 172.21.15.43:0/553688548 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8038040 con 0x7f0bf0003a00 2024-09-17T04:35:03.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.658+0000 7f0c0d762640 1 -- 172.21.15.43:0/553688548 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c081e1460 con 0x7f0bf0003a00 2024-09-17T04:35:03.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.658+0000 7f0c0d762640 1 -- 172.21.15.43:0/553688548 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c081f53b0 con 0x7f0bf0003a00 2024-09-17T04:35:03.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.659+0000 7f0c0d762640 1 -- 172.21.15.43:0/553688548 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c08070100 con 0x7f0bf0003a00 2024-09-17T04:35:03.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.660+0000 7f0bef7fe640 1 -- 172.21.15.43:0/553688548 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0bf8046070 con 0x7f0bf0003a00 2024-09-17T04:35:03.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.660+0000 7f0bef7fe640 1 --2- 172.21.15.43:0/553688548 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0bf4078bc0 0x7f0bf407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:03.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.660+0000 7f0bef7fe640 1 -- 172.21.15.43:0/553688548 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0bf80bb180 con 0x7f0bf0003a00 2024-09-17T04:35:03.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.661+0000 7f0c067fc640 1 --2- 172.21.15.43:0/553688548 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0bf4078bc0 0x7f0bf407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:03.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.661+0000 7f0c067fc640 1 --2- 172.21.15.43:0/553688548 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0bf4078bc0 0x7f0bf407b0d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0c080c9210 tx=0x7f0bfc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:03.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.665+0000 7f0bef7fe640 1 -- 172.21.15.43:0/553688548 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0bf80830c0 con 0x7f0bf0003a00 2024-09-17T04:35:03.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.892+0000 7f0c0d762640 1 -- 172.21.15.43:0/553688548 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0c080c8920 con 0x7f0bf0003a00 2024-09-17T04:35:03.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.892+0000 7f0bef7fe640 1 -- 172.21.15.43:0/553688548 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f0bf8087af0 con 0x7f0bf0003a00 2024-09-17T04:35:03.892 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:35:03.893 INFO:teuthology.orchestra.run.smithi043.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-09-17T04:35:03.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.894+0000 7f0c0d762640 1 -- 172.21.15.43:0/553688548 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0bf4078bc0 msgr2=0x7f0bf407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:03.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.894+0000 7f0c0d762640 1 --2- 172.21.15.43:0/553688548 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0bf4078bc0 0x7f0bf407b0d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0c080c9210 tx=0x7f0bfc005f90 comp rx=0 tx=0).stop 2024-09-17T04:35:03.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.894+0000 7f0c0d762640 1 -- 172.21.15.43:0/553688548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf0003a00 msgr2=0x7f0c0814ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:03.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.894+0000 7f0c0d762640 1 --2- 172.21.15.43:0/553688548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf0003a00 0x7f0c0814ab30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009c70 tx=0x7f0bf8033670 comp rx=0 tx=0).stop 2024-09-17T04:35:03.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.895+0000 7f0c0d762640 1 -- 172.21.15.43:0/553688548 shutdown_connections 2024-09-17T04:35:03.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.895+0000 7f0c0d762640 1 --2- 172.21.15.43:0/553688548 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f0bf4078bc0 0x7f0bf407b0d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.895+0000 7f0c0d762640 1 --2- 172.21.15.43:0/553688548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c08149130 0x7f0c08144750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.895+0000 7f0c0d762640 1 --2- 172.21.15.43:0/553688548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0c080b29b0 0x7f0c080cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.895+0000 7f0c0d762640 1 --2- 172.21.15.43:0/553688548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf0003a00 0x7f0c0814ab30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:03.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.895+0000 7f0c0d762640 1 -- 172.21.15.43:0/553688548 >> 172.21.15.43:0/553688548 conn(0x7f0c080738e0 msgr2=0x7f0c080b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:03.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.895+0000 7f0c0d762640 1 -- 172.21.15.43:0/553688548 shutdown_connections 2024-09-17T04:35:03.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:03.895+0000 7f0c0d762640 1 -- 172.21.15.43:0/553688548 wait complete. 2024-09-17T04:35:06.907 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T04:35:07.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.038+0000 7fbd27c69640 1 -- 172.21.15.43:0/3880174354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd0c004800 msgr2=0x7fbd0c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:07.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.038+0000 7fbd27c69640 1 --2- 172.21.15.43:0/3880174354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd0c004800 0x7fbd0c004c10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbd10006f60 tx=0x7fbd0c005830 comp rx=0 tx=0).stop 2024-09-17T04:35:07.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.038+0000 7fbd27c69640 1 -- 172.21.15.43:0/3880174354 shutdown_connections 2024-09-17T04:35:07.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.038+0000 7fbd27c69640 1 --2- 172.21.15.43:0/3880174354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd0c004800 0x7fbd0c004c10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.038+0000 7fbd27c69640 1 -- 172.21.15.43:0/3880174354 >> 172.21.15.43:0/3880174354 conn(0x7fbd2006f4e0 msgr2=0x7fbd2006f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:07.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.038+0000 7fbd27c69640 1 -- 172.21.15.43:0/3880174354 shutdown_connections 2024-09-17T04:35:07.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.038+0000 7fbd27c69640 1 -- 172.21.15.43:0/3880174354 wait complete. 2024-09-17T04:35:07.110 INFO:tasks.ceph.mds.f.smithi062.stderr:2024-09-17T04:35:07.038+0000 7f92a527c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T04:35:07.110 INFO:tasks.ceph.mds.f.smithi062.stderr:2024-09-17T04:35:07.038+0000 7f92a527c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-17T04:35:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.040+0000 7fbd27c69640 1 Processor -- start 2024-09-17T04:35:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.040+0000 7fbd27c69640 1 -- start start 2024-09-17T04:35:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.041+0000 7fbd27c69640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd0c004800 0x7fbd20157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.041+0000 7fbd27c69640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd201530f0 0x7fbd201f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.041+0000 7fbd27c69640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd200c5580 0x7fbd201f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.041+0000 7fbd27c69640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2015b990 con 0x7fbd200c5580 2024-09-17T04:35:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.041+0000 7fbd27c69640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2015c020 con 0x7fbd0c004800 2024-09-17T04:35:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.041+0000 7fbd27c69640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fbd200ccbd0 con 0x7fbd201530f0 2024-09-17T04:35:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.041+0000 7fbd26206640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd200c5580 0x7fbd201f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.041+0000 7fbd26206640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd200c5580 0x7fbd201f5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35562/0 (socket says 172.21.15.43:35562) 2024-09-17T04:35:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.041+0000 7fbd26206640 1 -- 172.21.15.43:0/3993913816 learned_addr learned my addr 172.21.15.43:0/3993913816 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.041+0000 7fbd25204640 1 --2- 172.21.15.43:0/3993913816 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd201530f0 0x7fbd201f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.041+0000 7fbd25a05640 1 --2- 172.21.15.43:0/3993913816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd0c004800 0x7fbd20157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.042+0000 7fbd26206640 1 -- 172.21.15.43:0/3993913816 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd201530f0 msgr2=0x7fbd201f55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.042+0000 7fbd26206640 1 --2- 172.21.15.43:0/3993913816 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd201530f0 0x7fbd201f55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.042+0000 7fbd26206640 1 -- 172.21.15.43:0/3993913816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd0c004800 msgr2=0x7fbd20157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.042+0000 7fbd26206640 1 --2- 172.21.15.43:0/3993913816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd0c004800 0x7fbd20157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.042+0000 7fbd26206640 1 -- 172.21.15.43:0/3993913816 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd20159390 con 0x7fbd200c5580 2024-09-17T04:35:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.042+0000 7fbd25204640 1 --2- 172.21.15.43:0/3993913816 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd201530f0 0x7fbd201f55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:35:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.042+0000 7fbd26206640 1 --2- 172.21.15.43:0/3993913816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd200c5580 0x7fbd201f5b20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbd200b67a0 tx=0x7fbd18001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.042+0000 7fbd167fc640 1 -- 172.21.15.43:0/3993913816 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18011870 con 0x7fbd200c5580 2024-09-17T04:35:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.042+0000 7fbd167fc640 1 -- 172.21.15.43:0/3993913816 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd18017070 con 0x7fbd200c5580 2024-09-17T04:35:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.042+0000 7fbd27c69640 1 -- 172.21.15.43:0/3993913816 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd201f6360 con 0x7fbd200c5580 2024-09-17T04:35:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.042+0000 7fbd167fc640 1 -- 172.21.15.43:0/3993913816 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18011da0 con 0x7fbd200c5580 2024-09-17T04:35:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.042+0000 7fbd27c69640 1 -- 172.21.15.43:0/3993913816 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd200c6fb0 con 0x7fbd200c5580 2024-09-17T04:35:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.043+0000 7fbd27c69640 1 -- 172.21.15.43:0/3993913816 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd2015b500 con 0x7fbd200c5580 2024-09-17T04:35:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.044+0000 7fbd167fc640 1 -- 172.21.15.43:0/3993913816 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd1801c460 con 0x7fbd200c5580 2024-09-17T04:35:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.045+0000 7fbd167fc640 1 --2- 172.21.15.43:0/3993913816 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fbd04078b90 0x7fbd0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.045+0000 7fbd167fc640 1 -- 172.21.15.43:0/3993913816 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbd1809b4b0 con 0x7fbd200c5580 2024-09-17T04:35:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.045+0000 7fbd25a05640 1 --2- 172.21.15.43:0/3993913816 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fbd04078b90 0x7fbd0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.046+0000 7fbd25a05640 1 --2- 172.21.15.43:0/3993913816 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fbd04078b90 0x7fbd0407b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c005eb0 tx=0x7fbd1c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.049+0000 7fbd167fc640 1 -- 172.21.15.43:0/3993913816 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd2015b500 con 0x7fbd200c5580 2024-09-17T04:35:07.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.276+0000 7fbd27c69640 1 -- 172.21.15.43:0/3993913816 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbd201f60c0 con 0x7fbd200c5580 2024-09-17T04:35:07.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.276+0000 7fbd167fc640 1 -- 172.21.15.43:0/3993913816 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fbd18063980 con 0x7fbd200c5580 2024-09-17T04:35:07.276 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:35:07.277 INFO:teuthology.orchestra.run.smithi043.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T04:35:07.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.279+0000 7fbd27c69640 1 -- 172.21.15.43:0/3993913816 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fbd04078b90 msgr2=0x7fbd0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:07.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.279+0000 7fbd27c69640 1 --2- 172.21.15.43:0/3993913816 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fbd04078b90 0x7fbd0407b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c005eb0 tx=0x7fbd1c005f90 comp rx=0 tx=0).stop 2024-09-17T04:35:07.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.279+0000 7fbd27c69640 1 -- 172.21.15.43:0/3993913816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd200c5580 msgr2=0x7fbd201f5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:07.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.279+0000 7fbd27c69640 1 --2- 172.21.15.43:0/3993913816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd200c5580 0x7fbd201f5b20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbd200b67a0 tx=0x7fbd18001b80 comp rx=0 tx=0).stop 2024-09-17T04:35:07.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.279+0000 7fbd27c69640 1 -- 172.21.15.43:0/3993913816 shutdown_connections 2024-09-17T04:35:07.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.279+0000 7fbd27c69640 1 --2- 172.21.15.43:0/3993913816 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fbd04078b90 0x7fbd0407b0a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.279+0000 7fbd27c69640 1 --2- 172.21.15.43:0/3993913816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd200c5580 0x7fbd201f5b20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.279+0000 7fbd27c69640 1 --2- 172.21.15.43:0/3993913816 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd201530f0 0x7fbd201f55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.279+0000 7fbd27c69640 1 --2- 172.21.15.43:0/3993913816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd0c004800 0x7fbd20157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.279+0000 7fbd27c69640 1 -- 172.21.15.43:0/3993913816 >> 172.21.15.43:0/3993913816 conn(0x7fbd2006f4e0 msgr2=0x7fbd200ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:07.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.279+0000 7fbd27c69640 1 -- 172.21.15.43:0/3993913816 shutdown_connections 2024-09-17T04:35:07.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.279+0000 7fbd27c69640 1 -- 172.21.15.43:0/3993913816 wait complete. 2024-09-17T04:35:07.290 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T04:35:07.290 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:35:07.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.406+0000 7f6d102be640 1 -- 172.21.15.43:0/781046403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d080cc4c0 msgr2=0x7f6d0815f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:07.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.406+0000 7f6d102be640 1 --2- 172.21.15.43:0/781046403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d080cc4c0 0x7f6d0815f990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009830 tx=0x7f6d0002a640 comp rx=0 tx=0).stop 2024-09-17T04:35:07.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.406+0000 7f6d102be640 1 -- 172.21.15.43:0/781046403 shutdown_connections 2024-09-17T04:35:07.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.406+0000 7f6d102be640 1 --2- 172.21.15.43:0/781046403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d080cc4c0 0x7f6d0815f990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.406+0000 7f6d102be640 1 -- 172.21.15.43:0/781046403 >> 172.21.15.43:0/781046403 conn(0x7f6d0806f4e0 msgr2=0x7f6d0806f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:07.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.406+0000 7f6d102be640 1 -- 172.21.15.43:0/781046403 shutdown_connections 2024-09-17T04:35:07.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.406+0000 7f6d102be640 1 -- 172.21.15.43:0/781046403 wait complete. 2024-09-17T04:35:07.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.408+0000 7f6d102be640 1 Processor -- start 2024-09-17T04:35:07.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.408+0000 7f6d102be640 1 -- start start 2024-09-17T04:35:07.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.409+0000 7f6d102be640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d080cc4c0 0x7f6d080d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:07.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.409+0000 7f6d102be640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d080ce230 0x7f6d08154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:07.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.409+0000 7f6d102be640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d080ce640 0x7f6d08158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:07.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.409+0000 7f6d102be640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0815b990 con 0x7f6d080ce640 2024-09-17T04:35:07.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.409+0000 7f6d102be640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0815c2a0 con 0x7f6d080cc4c0 2024-09-17T04:35:07.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.409+0000 7f6d102be640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6d080ccbd0 con 0x7f6d080ce230 2024-09-17T04:35:07.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.409+0000 7f6d0e85b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d080ce640 0x7f6d08158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:07.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.409+0000 7f6d0e85b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d080ce640 0x7f6d08158c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35578/0 (socket says 172.21.15.43:35578) 2024-09-17T04:35:07.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.409+0000 7f6d0e85b640 1 -- 172.21.15.43:0/2902296933 learned_addr learned my addr 172.21.15.43:0/2902296933 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:07.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.409+0000 7f6d0e05a640 1 --2- 172.21.15.43:0/2902296933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d080cc4c0 0x7f6d080d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:07.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.409+0000 7f6d0d859640 1 --2- 172.21.15.43:0/2902296933 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d080ce230 0x7f6d08154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:07.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.409+0000 7f6d0e85b640 1 -- 172.21.15.43:0/2902296933 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d080ce230 msgr2=0x7f6d08154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:07.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.409+0000 7f6d0e85b640 1 --2- 172.21.15.43:0/2902296933 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d080ce230 0x7f6d08154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.409+0000 7f6d0e85b640 1 -- 172.21.15.43:0/2902296933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d080cc4c0 msgr2=0x7f6d080d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:07.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.409+0000 7f6d0e85b640 1 --2- 172.21.15.43:0/2902296933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d080cc4c0 0x7f6d080d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.409+0000 7f6d0e85b640 1 -- 172.21.15.43:0/2902296933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d080d0ff0 con 0x7f6d080ce640 2024-09-17T04:35:07.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.410+0000 7f6d0e85b640 1 --2- 172.21.15.43:0/2902296933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d080ce640 0x7f6d08158c20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800c700 tx=0x7f6cf800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:07.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.410+0000 7f6d06ffd640 1 -- 172.21.15.43:0/2902296933 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8003b70 con 0x7f6d080ce640 2024-09-17T04:35:07.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.410+0000 7f6d06ffd640 1 -- 172.21.15.43:0/2902296933 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cf8003d10 con 0x7f6d080ce640 2024-09-17T04:35:07.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.410+0000 7f6d102be640 1 -- 172.21.15.43:0/2902296933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d080d1600 con 0x7f6d080ce640 2024-09-17T04:35:07.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.410+0000 7f6d06ffd640 1 -- 172.21.15.43:0/2902296933 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf800aab0 con 0x7f6d080ce640 2024-09-17T04:35:07.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.410+0000 7f6d102be640 1 -- 172.21.15.43:0/2902296933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d080c6410 con 0x7f6d080ce640 2024-09-17T04:35:07.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.411+0000 7f6d102be640 1 -- 172.21.15.43:0/2902296933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d080d1370 con 0x7f6d080ce640 2024-09-17T04:35:07.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.412+0000 7f6d06ffd640 1 -- 172.21.15.43:0/2902296933 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6cf800ac50 con 0x7f6d080ce640 2024-09-17T04:35:07.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.412+0000 7f6d06ffd640 1 --2- 172.21.15.43:0/2902296933 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f6cf4078b90 0x7f6cf407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:07.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.412+0000 7f6d06ffd640 1 -- 172.21.15.43:0/2902296933 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6cf809a930 con 0x7f6d080ce640 2024-09-17T04:35:07.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.412+0000 7f6d0e05a640 1 --2- 172.21.15.43:0/2902296933 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f6cf4078b90 0x7f6cf407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:07.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.413+0000 7f6d0e05a640 1 --2- 172.21.15.43:0/2902296933 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f6cf4078b90 0x7f6cf407b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6d00034000 tx=0x7f6d00004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:07.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.417+0000 7f6d06ffd640 1 -- 172.21.15.43:0/2902296933 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6cf80627b0 con 0x7f6d080ce640 2024-09-17T04:35:07.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.638+0000 7f6d102be640 1 -- 172.21.15.43:0/2902296933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d080cb3f0 con 0x7f6d080ce640 2024-09-17T04:35:07.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.638+0000 7f6d06ffd640 1 -- 172.21.15.43:0/2902296933 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6893 (secure 0 0 0) 0x7f6cf80671e0 con 0x7f6d080ce640 2024-09-17T04:35:07.638 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:35:07.639 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":12,"btime":"2024-09-17T04:35:04:121600+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/424910095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6835","nonce":424910095},{"type":"v1","addr":"172.21.15.62:6837","nonce":424910095}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6836/882111784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":882111784},{"type":"v1","addr":"172.21.15.62:6836","nonce":882111784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4431,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/47250523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":47250523},{"type":"v1","addr":"172.21.15.43:6834","nonce":47250523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:34:51.443546+0000","modified":"2024-09-17T04:35:04.121577+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4455,"mds_1":4437,"mds_2":4434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4434":{"gid":4434,"name":"c","rank":2,"incarnation":12,"state":"up:creating","state_seq":1,"addr":"172.21.15.43:6835/3276393888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":3276393888},{"type":"v1","addr":"172.21.15.43:6835","nonce":3276393888}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4437":{"gid":4437,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.43:6837/3935895854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":3935895854},{"type":"v1","addr":"172.21.15.43:6837","nonce":3935895854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4455":{"gid":4455,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6839/3263944095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3263944095},{"type":"v1","addr":"172.21.15.62:6839","nonce":3263944095}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4455,"qdb_cluster":[4455,4437]},"id":1}]} 2024-09-17T04:35:07.639 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 12 2024-09-17T04:35:07.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.641+0000 7f6d102be640 1 -- 172.21.15.43:0/2902296933 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f6cf4078b90 msgr2=0x7f6cf407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:07.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.641+0000 7f6d102be640 1 --2- 172.21.15.43:0/2902296933 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f6cf4078b90 0x7f6cf407b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6d00034000 tx=0x7f6d00004730 comp rx=0 tx=0).stop 2024-09-17T04:35:07.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.641+0000 7f6d102be640 1 -- 172.21.15.43:0/2902296933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d080ce640 msgr2=0x7f6d08158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:07.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.641+0000 7f6d102be640 1 --2- 172.21.15.43:0/2902296933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d080ce640 0x7f6d08158c20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800c700 tx=0x7f6cf800cbc0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.641+0000 7f6d102be640 1 -- 172.21.15.43:0/2902296933 shutdown_connections 2024-09-17T04:35:07.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.641+0000 7f6d102be640 1 --2- 172.21.15.43:0/2902296933 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f6cf4078b90 0x7f6cf407b0a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.641+0000 7f6d102be640 1 --2- 172.21.15.43:0/2902296933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d080ce640 0x7f6d08158c20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.641+0000 7f6d102be640 1 --2- 172.21.15.43:0/2902296933 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d080ce230 0x7f6d08154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.641+0000 7f6d102be640 1 --2- 172.21.15.43:0/2902296933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d080cc4c0 0x7f6d080d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.641+0000 7f6d102be640 1 -- 172.21.15.43:0/2902296933 >> 172.21.15.43:0/2902296933 conn(0x7f6d0806f4e0 msgr2=0x7f6d081556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.641+0000 7f6d102be640 1 -- 172.21.15.43:0/2902296933 shutdown_connections 2024-09-17T04:35:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.641+0000 7f6d102be640 1 -- 172.21.15.43:0/2902296933 wait complete. 2024-09-17T04:35:07.652 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:35:07.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.767+0000 7fab87807640 1 -- 172.21.15.43:0/4279464087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab8015f990 msgr2=0x7fab800cabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:07.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.767+0000 7fab87807640 1 --2- 172.21.15.43:0/4279464087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab8015f990 0x7fab800cabb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fab70009830 tx=0x7fab7002a5a0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.768+0000 7fab87807640 1 -- 172.21.15.43:0/4279464087 shutdown_connections 2024-09-17T04:35:07.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.768+0000 7fab87807640 1 --2- 172.21.15.43:0/4279464087 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab800cb0f0 0x7fab800b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.768+0000 7fab87807640 1 --2- 172.21.15.43:0/4279464087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab8015f990 0x7fab800cabb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.768+0000 7fab87807640 1 -- 172.21.15.43:0/4279464087 >> 172.21.15.43:0/4279464087 conn(0x7fab8006f4e0 msgr2=0x7fab8006f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:07.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.768+0000 7fab87807640 1 -- 172.21.15.43:0/4279464087 shutdown_connections 2024-09-17T04:35:07.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.768+0000 7fab87807640 1 -- 172.21.15.43:0/4279464087 wait complete. 2024-09-17T04:35:07.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.769+0000 7fab87807640 1 Processor -- start 2024-09-17T04:35:07.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.769+0000 7fab87807640 1 -- start start 2024-09-17T04:35:07.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab87807640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab800cb0f0 0x7fab801547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:07.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab87807640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab800cc4c0 0x7fab8014e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:07.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab87807640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab8015f990 0x7fab80153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:07.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab87807640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fab8015c2a0 con 0x7fab800cb0f0 2024-09-17T04:35:07.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab87807640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fab8015fda0 con 0x7fab8015f990 2024-09-17T04:35:07.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab87807640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fab8015b990 con 0x7fab800cc4c0 2024-09-17T04:35:07.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab855a3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab800cb0f0 0x7fab801547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:07.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab855a3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab800cb0f0 0x7fab801547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35594/0 (socket says 172.21.15.43:35594) 2024-09-17T04:35:07.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab855a3640 1 -- 172.21.15.43:0/3115750005 learned_addr learned my addr 172.21.15.43:0/3115750005 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:07.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab85da4640 1 --2- 172.21.15.43:0/3115750005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab8015f990 0x7fab80153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:07.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab84da2640 1 --2- 172.21.15.43:0/3115750005 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab800cc4c0 0x7fab8014e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:07.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab855a3640 1 -- 172.21.15.43:0/3115750005 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab800cc4c0 msgr2=0x7fab8014e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:07.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab855a3640 1 --2- 172.21.15.43:0/3115750005 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab800cc4c0 0x7fab8014e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab855a3640 1 -- 172.21.15.43:0/3115750005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab8015f990 msgr2=0x7fab80153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:07.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab855a3640 1 --2- 172.21.15.43:0/3115750005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab8015f990 0x7fab80153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:07.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab855a3640 1 -- 172.21.15.43:0/3115750005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab80154d00 con 0x7fab800cb0f0 2024-09-17T04:35:07.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab855a3640 1 --2- 172.21.15.43:0/3115750005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab800cb0f0 0x7fab801547c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00c460 tx=0x7fab7c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:07.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.771+0000 7fab75ffb640 1 -- 172.21.15.43:0/3115750005 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c016020 con 0x7fab800cb0f0 2024-09-17T04:35:07.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.772+0000 7fab75ffb640 1 -- 172.21.15.43:0/3115750005 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab7c012940 con 0x7fab800cb0f0 2024-09-17T04:35:07.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.772+0000 7fab87807640 1 -- 172.21.15.43:0/3115750005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8014f6d0 con 0x7fab800cb0f0 2024-09-17T04:35:07.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.772+0000 7fab75ffb640 1 -- 172.21.15.43:0/3115750005 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c012d90 con 0x7fab800cb0f0 2024-09-17T04:35:07.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.772+0000 7fab87807640 1 -- 172.21.15.43:0/3115750005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab80152870 con 0x7fab800cb0f0 2024-09-17T04:35:07.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.773+0000 7fab87807640 1 -- 172.21.15.43:0/3115750005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab800ccc20 con 0x7fab800cb0f0 2024-09-17T04:35:07.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.773+0000 7fab75ffb640 1 -- 172.21.15.43:0/3115750005 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab7c019020 con 0x7fab800cb0f0 2024-09-17T04:35:07.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.774+0000 7fab75ffb640 1 --2- 172.21.15.43:0/3115750005 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fab64078bc0 0x7fab6407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:07.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.774+0000 7fab75ffb640 1 -- 172.21.15.43:0/3115750005 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fab7c09a810 con 0x7fab800cb0f0 2024-09-17T04:35:07.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.774+0000 7fab84da2640 1 --2- 172.21.15.43:0/3115750005 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fab64078bc0 0x7fab6407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:07.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.775+0000 7fab84da2640 1 --2- 172.21.15.43:0/3115750005 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fab64078bc0 0x7fab6407b0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fab70034000 tx=0x7fab70004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:07.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:07.778+0000 7fab75ffb640 1 -- 172.21.15.43:0/3115750005 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fab7c020030 con 0x7fab800cb0f0 2024-09-17T04:35:08.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.001+0000 7fab87807640 1 -- 172.21.15.43:0/3115750005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab801e5ec0 con 0x7fab800cb0f0 2024-09-17T04:35:08.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.002+0000 7fab75ffb640 1 -- 172.21.15.43:0/3115750005 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6893 (secure 0 0 0) 0x7fab7c062680 con 0x7fab800cb0f0 2024-09-17T04:35:08.002 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:35:08.002 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":12,"btime":"2024-09-17T04:35:04:121600+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/424910095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6835","nonce":424910095},{"type":"v1","addr":"172.21.15.62:6837","nonce":424910095}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6836/882111784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":882111784},{"type":"v1","addr":"172.21.15.62:6836","nonce":882111784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4431,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/47250523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":47250523},{"type":"v1","addr":"172.21.15.43:6834","nonce":47250523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:34:51.443546+0000","modified":"2024-09-17T04:35:04.121577+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4455,"mds_1":4437,"mds_2":4434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4434":{"gid":4434,"name":"c","rank":2,"incarnation":12,"state":"up:creating","state_seq":1,"addr":"172.21.15.43:6835/3276393888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":3276393888},{"type":"v1","addr":"172.21.15.43:6835","nonce":3276393888}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4437":{"gid":4437,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.43:6837/3935895854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":3935895854},{"type":"v1","addr":"172.21.15.43:6837","nonce":3935895854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4455":{"gid":4455,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6839/3263944095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3263944095},{"type":"v1","addr":"172.21.15.62:6839","nonce":3263944095}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4455,"qdb_cluster":[4455,4437]},"id":1}]} 2024-09-17T04:35:08.003 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 12 2024-09-17T04:35:08.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.004+0000 7fab87807640 1 -- 172.21.15.43:0/3115750005 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fab64078bc0 msgr2=0x7fab6407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:08.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.004+0000 7fab87807640 1 --2- 172.21.15.43:0/3115750005 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fab64078bc0 0x7fab6407b0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fab70034000 tx=0x7fab70004730 comp rx=0 tx=0).stop 2024-09-17T04:35:08.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.004+0000 7fab87807640 1 -- 172.21.15.43:0/3115750005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab800cb0f0 msgr2=0x7fab801547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:08.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.004+0000 7fab87807640 1 --2- 172.21.15.43:0/3115750005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab800cb0f0 0x7fab801547c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00c460 tx=0x7fab7c00c920 comp rx=0 tx=0).stop 2024-09-17T04:35:08.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.004+0000 7fab87807640 1 -- 172.21.15.43:0/3115750005 shutdown_connections 2024-09-17T04:35:08.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.004+0000 7fab87807640 1 --2- 172.21.15.43:0/3115750005 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fab64078bc0 0x7fab6407b0d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.004+0000 7fab87807640 1 --2- 172.21.15.43:0/3115750005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab8015f990 0x7fab80153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.004+0000 7fab87807640 1 --2- 172.21.15.43:0/3115750005 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab800cc4c0 0x7fab8014e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.004+0000 7fab87807640 1 --2- 172.21.15.43:0/3115750005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab800cb0f0 0x7fab801547c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.004+0000 7fab87807640 1 -- 172.21.15.43:0/3115750005 >> 172.21.15.43:0/3115750005 conn(0x7fab8006f4e0 msgr2=0x7fab800b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:08.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.004+0000 7fab87807640 1 -- 172.21.15.43:0/3115750005 shutdown_connections 2024-09-17T04:35:08.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.004+0000 7fab87807640 1 -- 172.21.15.43:0/3115750005 wait complete. 2024-09-17T04:35:08.015 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:35:08.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.134+0000 7f4e07d19640 1 -- 172.21.15.43:0/1649071926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e000b4db0 msgr2=0x7f4e000caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:08.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.134+0000 7f4e07d19640 1 --2- 172.21.15.43:0/1649071926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e000b4db0 0x7f4e000caf00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4e000cebc0 tx=0x7f4dfc02a950 comp rx=0 tx=0).stop 2024-09-17T04:35:08.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.134+0000 7f4e07d19640 1 -- 172.21.15.43:0/1649071926 shutdown_connections 2024-09-17T04:35:08.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.134+0000 7f4e07d19640 1 --2- 172.21.15.43:0/1649071926 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e000ccd60 0x7f4e000ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.134+0000 7f4e07d19640 1 --2- 172.21.15.43:0/1649071926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e000b4db0 0x7f4e000caf00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.134+0000 7f4e07d19640 1 -- 172.21.15.43:0/1649071926 >> 172.21.15.43:0/1649071926 conn(0x7f4e0006f4e0 msgr2=0x7f4e0006f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:08.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.134+0000 7f4e07d19640 1 -- 172.21.15.43:0/1649071926 shutdown_connections 2024-09-17T04:35:08.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.134+0000 7f4e07d19640 1 -- 172.21.15.43:0/1649071926 wait complete. 2024-09-17T04:35:08.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.135+0000 7f4e07d19640 1 Processor -- start 2024-09-17T04:35:08.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.136+0000 7f4e07d19640 1 -- start start 2024-09-17T04:35:08.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.137+0000 7f4e07d19640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e000b4db0 0x7f4e001f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:08.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.137+0000 7f4e07d19640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e000ccd60 0x7f4e001e3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:08.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.137+0000 7f4e07d19640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e000cd670 0x7f4e001e5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:08.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.137+0000 7f4e07d19640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4e000b5ab0 con 0x7f4e000ccd60 2024-09-17T04:35:08.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.137+0000 7f4e07d19640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4e000b57d0 con 0x7f4e000cd670 2024-09-17T04:35:08.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.137+0000 7f4e07d19640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4e000cb440 con 0x7f4e000b4db0 2024-09-17T04:35:08.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.137+0000 7f4e052b4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e000ccd60 0x7f4e001e3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:08.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.137+0000 7f4e052b4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e000ccd60 0x7f4e001e3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35598/0 (socket says 172.21.15.43:35598) 2024-09-17T04:35:08.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.137+0000 7f4e052b4640 1 -- 172.21.15.43:0/884679018 learned_addr learned my addr 172.21.15.43:0/884679018 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:08.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.137+0000 7f4e05ab5640 1 --2- 172.21.15.43:0/884679018 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e000b4db0 0x7f4e001f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:08.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.137+0000 7f4e062b6640 1 --2- 172.21.15.43:0/884679018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e000cd670 0x7f4e001e5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:08.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.137+0000 7f4e052b4640 1 -- 172.21.15.43:0/884679018 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e000b4db0 msgr2=0x7f4e001f2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:08.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.137+0000 7f4e052b4640 1 --2- 172.21.15.43:0/884679018 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e000b4db0 0x7f4e001f2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.137+0000 7f4e052b4640 1 -- 172.21.15.43:0/884679018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e000cd670 msgr2=0x7f4e001e5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:08.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.137+0000 7f4e052b4640 1 --2- 172.21.15.43:0/884679018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e000cd670 0x7f4e001e5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.137+0000 7f4e052b4640 1 -- 172.21.15.43:0/884679018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e00154040 con 0x7f4e000ccd60 2024-09-17T04:35:08.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.138+0000 7f4e052b4640 1 --2- 172.21.15.43:0/884679018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e000ccd60 0x7f4e001e3c60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4df000b3c0 tx=0x7f4df000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:08.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.140+0000 7f4df67fc640 1 -- 172.21.15.43:0/884679018 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0011830 con 0x7f4e000ccd60 2024-09-17T04:35:08.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.140+0000 7f4df67fc640 1 -- 172.21.15.43:0/884679018 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4df0016070 con 0x7f4e000ccd60 2024-09-17T04:35:08.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.140+0000 7f4e07d19640 1 -- 172.21.15.43:0/884679018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e001f5f90 con 0x7f4e000ccd60 2024-09-17T04:35:08.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.140+0000 7f4df67fc640 1 -- 172.21.15.43:0/884679018 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0011da0 con 0x7f4e000ccd60 2024-09-17T04:35:08.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.140+0000 7f4e07d19640 1 -- 172.21.15.43:0/884679018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e001f1c60 con 0x7f4e000ccd60 2024-09-17T04:35:08.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.141+0000 7f4e07d19640 1 -- 172.21.15.43:0/884679018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e000b5fd0 con 0x7f4e000ccd60 2024-09-17T04:35:08.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.142+0000 7f4df67fc640 1 -- 172.21.15.43:0/884679018 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4df001b460 con 0x7f4e000ccd60 2024-09-17T04:35:08.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.142+0000 7f4df67fc640 1 --2- 172.21.15.43:0/884679018 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4de4078b90 0x7f4de407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:08.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.142+0000 7f4df67fc640 1 -- 172.21.15.43:0/884679018 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4df009a7c0 con 0x7f4e000ccd60 2024-09-17T04:35:08.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.143+0000 7f4e05ab5640 1 --2- 172.21.15.43:0/884679018 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4de4078b90 0x7f4de407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:08.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.143+0000 7f4e05ab5640 1 --2- 172.21.15.43:0/884679018 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4de4078b90 0x7f4de407b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc035000 tx=0x7f4dfc004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:08.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.147+0000 7f4df67fc640 1 -- 172.21.15.43:0/884679018 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4df0020020 con 0x7f4e000ccd60 2024-09-17T04:35:08.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.333+0000 7f4e07d19640 1 -- 172.21.15.43:0/884679018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e00076790 con 0x7f4e000ccd60 2024-09-17T04:35:08.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.334+0000 7f4df67fc640 1 -- 172.21.15.43:0/884679018 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16641 (secure 0 0 0) 0x7f4df00625c0 con 0x7f4e000ccd60 2024-09-17T04:35:08.334 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:35:08.335 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":22,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","created":"2024-09-17T04:34:26.485007+0000","modified":"2024-09-17T04:34:53.066747+0000","last_up_change":"2024-09-17T04:34:40.712497+0000","last_in_change":"2024-09-17T04:34:30.384271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:34:38.905735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:34:49.341236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:34:50.401489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eaab925a-60b4-429f-aee1-50de6f32358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6817","nonce":1685480205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6819","nonce":1685480205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6823","nonce":1685480205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6821","nonce":1685480205}]},"public_addr":"172.21.15.43:6817/1685480205","cluster_addr":"172.21.15.43:6819/1685480205","heartbeat_back_addr":"172.21.15.43:6823/1685480205","heartbeat_front_addr":"172.21.15.43:6821/1685480205","state":["exists","up"]},{"osd":1,"uuid":"2c0e64be-db05-45db-aad8-2f2f42812100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6825","nonce":1564354446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6827","nonce":1564354446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6831","nonce":1564354446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6829","nonce":1564354446}]},"public_addr":"172.21.15.43:6825/1564354446","cluster_addr":"172.21.15.43:6827/1564354446","heartbeat_back_addr":"172.21.15.43:6831/1564354446","heartbeat_front_addr":"172.21.15.43:6829/1564354446","state":["exists","up"]},{"osd":2,"uuid":"fa88665d-2acb-4e44-99ac-1d496adf5b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6801","nonce":1385342605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6803","nonce":1385342605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6807","nonce":1385342605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6805","nonce":1385342605}]},"public_addr":"172.21.15.43:6801/1385342605","cluster_addr":"172.21.15.43:6803/1385342605","heartbeat_back_addr":"172.21.15.43:6807/1385342605","heartbeat_front_addr":"172.21.15.43:6805/1385342605","state":["exists","up"]},{"osd":3,"uuid":"710a28f0-d04a-4b4a-bba3-28f7c7b1eb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6809","nonce":1646004903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6811","nonce":1646004903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6815","nonce":1646004903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6813","nonce":1646004903}]},"public_addr":"172.21.15.43:6809/1646004903","cluster_addr":"172.21.15.43:6811/1646004903","heartbeat_back_addr":"172.21.15.43:6815/1646004903","heartbeat_front_addr":"172.21.15.43:6813/1646004903","state":["exists","up"]},{"osd":4,"uuid":"d2eca96b-1917-4dbb-b6e3-f4410bbc5c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6803","nonce":3991694106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6805","nonce":3991694106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6809","nonce":3991694106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6807","nonce":3991694106}]},"public_addr":"172.21.15.62:6803/3991694106","cluster_addr":"172.21.15.62:6805/3991694106","heartbeat_back_addr":"172.21.15.62:6809/3991694106","heartbeat_front_addr":"172.21.15.62:6807/3991694106","state":["exists","up"]},{"osd":5,"uuid":"ae843bea-38ff-4ca6-a7a9-6e58c7a17fd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6827","nonce":2558615114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6829","nonce":2558615114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6833","nonce":2558615114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6831","nonce":2558615114}]},"public_addr":"172.21.15.62:6827/2558615114","cluster_addr":"172.21.15.62:6829/2558615114","heartbeat_back_addr":"172.21.15.62:6833/2558615114","heartbeat_front_addr":"172.21.15.62:6831/2558615114","state":["exists","up"]},{"osd":6,"uuid":"44c53356-010d-443f-9e8d-f0d5da106893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6811","nonce":1901653154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6813","nonce":1901653154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6817","nonce":1901653154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6815","nonce":1901653154}]},"public_addr":"172.21.15.62:6811/1901653154","cluster_addr":"172.21.15.62:6813/1901653154","heartbeat_back_addr":"172.21.15.62:6817/1901653154","heartbeat_front_addr":"172.21.15.62:6815/1901653154","state":["exists","up"]},{"osd":7,"uuid":"c8960d11-dd10-4e36-b9d8-f1fdc0abe9c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6819","nonce":2974376041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6821","nonce":2974376041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6825","nonce":2974376041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6823","nonce":2974376041}]},"public_addr":"172.21.15.62:6819/2974376041","cluster_addr":"172.21.15.62:6821/2974376041","heartbeat_back_addr":"172.21.15.62:6825/2974376041","heartbeat_front_addr":"172.21.15.62:6823/2974376041","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.435063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.372079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:35.973575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.690029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.944690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.691776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.877497+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.689786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:35:08.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.336+0000 7f4e07d19640 1 -- 172.21.15.43:0/884679018 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4de4078b90 msgr2=0x7f4de407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:08.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.336+0000 7f4e07d19640 1 --2- 172.21.15.43:0/884679018 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4de4078b90 0x7f4de407b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc035000 tx=0x7f4dfc004ab0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.337+0000 7f4e07d19640 1 -- 172.21.15.43:0/884679018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e000ccd60 msgr2=0x7f4e001e3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:08.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.337+0000 7f4e07d19640 1 --2- 172.21.15.43:0/884679018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e000ccd60 0x7f4e001e3c60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4df000b3c0 tx=0x7f4df000b880 comp rx=0 tx=0).stop 2024-09-17T04:35:08.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.337+0000 7f4e07d19640 1 -- 172.21.15.43:0/884679018 shutdown_connections 2024-09-17T04:35:08.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.337+0000 7f4e07d19640 1 --2- 172.21.15.43:0/884679018 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4de4078b90 0x7f4de407b0a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.337+0000 7f4e07d19640 1 --2- 172.21.15.43:0/884679018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e000cd670 0x7f4e001e5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.337+0000 7f4e07d19640 1 --2- 172.21.15.43:0/884679018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e000ccd60 0x7f4e001e3c60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.337+0000 7f4e07d19640 1 --2- 172.21.15.43:0/884679018 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e000b4db0 0x7f4e001f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.337+0000 7f4e07d19640 1 -- 172.21.15.43:0/884679018 >> 172.21.15.43:0/884679018 conn(0x7f4e0006f4e0 msgr2=0x7f4e00159770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:08.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.337+0000 7f4e07d19640 1 -- 172.21.15.43:0/884679018 shutdown_connections 2024-09-17T04:35:08.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.337+0000 7f4e07d19640 1 -- 172.21.15.43:0/884679018 wait complete. 2024-09-17T04:35:08.348 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:35:08.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.465+0000 7f9a2252b640 1 -- 172.21.15.43:0/90430524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a04004800 msgr2=0x7f9a04004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:08.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.465+0000 7f9a2252b640 1 --2- 172.21.15.43:0/90430524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a04004800 0x7f9a04004c10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009b50 tx=0x7f9a04005830 comp rx=0 tx=0).stop 2024-09-17T04:35:08.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.465+0000 7f9a20ac8640 1 -- 172.21.15.43:0/90430524 reap_dead start 2024-09-17T04:35:08.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.465+0000 7f9a2252b640 1 -- 172.21.15.43:0/90430524 shutdown_connections 2024-09-17T04:35:08.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.465+0000 7f9a2252b640 1 -- 172.21.15.43:0/90430524 >> 172.21.15.43:0/90430524 conn(0x7f9a1c072f60 msgr2=0x7f9a1c0cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:08.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.465+0000 7f9a2252b640 1 -- 172.21.15.43:0/90430524 shutdown_connections 2024-09-17T04:35:08.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.465+0000 7f9a2252b640 1 -- 172.21.15.43:0/90430524 wait complete. 2024-09-17T04:35:08.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.466+0000 7f9a2252b640 1 Processor -- start 2024-09-17T04:35:08.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.467+0000 7f9a2252b640 1 -- start start 2024-09-17T04:35:08.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.468+0000 7f9a2252b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a04004800 0x7f9a1c1efaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:08.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.468+0000 7f9a2252b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a1c155fb0 0x7f9a1c0ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:08.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.468+0000 7f9a2252b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a1c0ce770 0x7f9a1c1478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:08.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.468+0000 7f9a2252b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c0c9a10 con 0x7f9a1c155fb0 2024-09-17T04:35:08.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.468+0000 7f9a2252b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c15db10 con 0x7f9a04004800 2024-09-17T04:35:08.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.468+0000 7f9a2252b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9a1c070990 con 0x7f9a1c0ce770 2024-09-17T04:35:08.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.468+0000 7f9a1b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a1c155fb0 0x7f9a1c0ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:08.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.468+0000 7f9a1b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a1c155fb0 0x7f9a1c0ce230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35610/0 (socket says 172.21.15.43:35610) 2024-09-17T04:35:08.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.468+0000 7f9a1b7fe640 1 -- 172.21.15.43:0/859887880 learned_addr learned my addr 172.21.15.43:0/859887880 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:08.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.468+0000 7f9a1bfff640 1 --2- 172.21.15.43:0/859887880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a04004800 0x7f9a1c1efaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:08.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.468+0000 7f9a20ac8640 1 --2- 172.21.15.43:0/859887880 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a1c0ce770 0x7f9a1c1478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:08.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.468+0000 7f9a1b7fe640 1 -- 172.21.15.43:0/859887880 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a1c0ce770 msgr2=0x7f9a1c1478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:08.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.468+0000 7f9a1b7fe640 1 --2- 172.21.15.43:0/859887880 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a1c0ce770 0x7f9a1c1478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.468+0000 7f9a1b7fe640 1 -- 172.21.15.43:0/859887880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a04004800 msgr2=0x7f9a1c1efaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:08.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.468+0000 7f9a1b7fe640 1 --2- 172.21.15.43:0/859887880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a04004800 0x7f9a1c1efaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.468+0000 7f9a1b7fe640 1 -- 172.21.15.43:0/859887880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1c154310 con 0x7f9a1c155fb0 2024-09-17T04:35:08.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.468+0000 7f9a1bfff640 1 --2- 172.21.15.43:0/859887880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a04004800 0x7f9a1c1efaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:35:08.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.469+0000 7f9a1b7fe640 1 --2- 172.21.15.43:0/859887880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a1c155fb0 0x7f9a1c0ce230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9a1002b590 tx=0x7f9a10009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:08.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.469+0000 7f9a18ff9640 1 -- 172.21.15.43:0/859887880 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a10043070 con 0x7f9a1c155fb0 2024-09-17T04:35:08.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.469+0000 7f9a18ff9640 1 -- 172.21.15.43:0/859887880 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a10004340 con 0x7f9a1c155fb0 2024-09-17T04:35:08.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.469+0000 7f9a2252b640 1 -- 172.21.15.43:0/859887880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1c1545f0 con 0x7f9a1c155fb0 2024-09-17T04:35:08.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.469+0000 7f9a18ff9640 1 -- 172.21.15.43:0/859887880 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a10038040 con 0x7f9a1c155fb0 2024-09-17T04:35:08.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.469+0000 7f9a2252b640 1 -- 172.21.15.43:0/859887880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a1c154bb0 con 0x7f9a1c155fb0 2024-09-17T04:35:08.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.470+0000 7f9a2252b640 1 -- 172.21.15.43:0/859887880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a1c153a50 con 0x7f9a1c155fb0 2024-09-17T04:35:08.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.470+0000 7f9a18ff9640 1 -- 172.21.15.43:0/859887880 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a10046070 con 0x7f9a1c155fb0 2024-09-17T04:35:08.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.471+0000 7f9a18ff9640 1 --2- 172.21.15.43:0/859887880 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9a08078bc0 0x7f9a0807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:08.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.471+0000 7f9a18ff9640 1 -- 172.21.15.43:0/859887880 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9a100bb260 con 0x7f9a1c155fb0 2024-09-17T04:35:08.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.471+0000 7f9a1bfff640 1 --2- 172.21.15.43:0/859887880 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9a08078bc0 0x7f9a0807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:08.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.472+0000 7f9a1bfff640 1 --2- 172.21.15.43:0/859887880 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9a08078bc0 0x7f9a0807b0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c009c50 tx=0x7f9a0c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:08.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.476+0000 7f9a18ff9640 1 -- 172.21.15.43:0/859887880 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9a100830e0 con 0x7f9a1c155fb0 2024-09-17T04:35:08.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.696+0000 7f9a2252b640 1 -- 172.21.15.43:0/859887880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a1c14db60 con 0x7f9a1c155fb0 2024-09-17T04:35:08.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.696+0000 7f9a18ff9640 1 -- 172.21.15.43:0/859887880 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6893 (secure 0 0 0) 0x7f9a10087b10 con 0x7f9a1c155fb0 2024-09-17T04:35:08.697 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:35:08.697 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":12,"btime":"2024-09-17T04:35:04:121600+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/424910095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6835","nonce":424910095},{"type":"v1","addr":"172.21.15.62:6837","nonce":424910095}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6836/882111784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":882111784},{"type":"v1","addr":"172.21.15.62:6836","nonce":882111784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4431,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/47250523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":47250523},{"type":"v1","addr":"172.21.15.43:6834","nonce":47250523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:34:51.443546+0000","modified":"2024-09-17T04:35:04.121577+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4455,"mds_1":4437,"mds_2":4434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4434":{"gid":4434,"name":"c","rank":2,"incarnation":12,"state":"up:creating","state_seq":1,"addr":"172.21.15.43:6835/3276393888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":3276393888},{"type":"v1","addr":"172.21.15.43:6835","nonce":3276393888}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4437":{"gid":4437,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.43:6837/3935895854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":3935895854},{"type":"v1","addr":"172.21.15.43:6837","nonce":3935895854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4455":{"gid":4455,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6839/3263944095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3263944095},{"type":"v1","addr":"172.21.15.62:6839","nonce":3263944095}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4455,"qdb_cluster":[4455,4437]},"id":1}]} 2024-09-17T04:35:08.697 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 12 2024-09-17T04:35:08.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.698+0000 7f9a2252b640 1 -- 172.21.15.43:0/859887880 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9a08078bc0 msgr2=0x7f9a0807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:08.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.698+0000 7f9a2252b640 1 --2- 172.21.15.43:0/859887880 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9a08078bc0 0x7f9a0807b0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c009c50 tx=0x7f9a0c005f90 comp rx=0 tx=0).stop 2024-09-17T04:35:08.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.698+0000 7f9a2252b640 1 -- 172.21.15.43:0/859887880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a1c155fb0 msgr2=0x7f9a1c0ce230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:08.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.698+0000 7f9a2252b640 1 --2- 172.21.15.43:0/859887880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a1c155fb0 0x7f9a1c0ce230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9a1002b590 tx=0x7f9a10009850 comp rx=0 tx=0).stop 2024-09-17T04:35:08.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.699+0000 7f9a2252b640 1 -- 172.21.15.43:0/859887880 shutdown_connections 2024-09-17T04:35:08.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.699+0000 7f9a2252b640 1 --2- 172.21.15.43:0/859887880 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9a08078bc0 0x7f9a0807b0d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.699+0000 7f9a2252b640 1 --2- 172.21.15.43:0/859887880 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a1c0ce770 0x7f9a1c1478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.699+0000 7f9a2252b640 1 --2- 172.21.15.43:0/859887880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a1c155fb0 0x7f9a1c0ce230 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.699+0000 7f9a2252b640 1 --2- 172.21.15.43:0/859887880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a04004800 0x7f9a1c1efaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:08.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.699+0000 7f9a2252b640 1 -- 172.21.15.43:0/859887880 >> 172.21.15.43:0/859887880 conn(0x7f9a1c072f60 msgr2=0x7f9a1c14dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:08.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.699+0000 7f9a2252b640 1 -- 172.21.15.43:0/859887880 shutdown_connections 2024-09-17T04:35:08.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:08.699+0000 7f9a2252b640 1 -- 172.21.15.43:0/859887880 wait complete. 2024-09-17T04:35:09.313 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T04:34:51.443546+0000', 'modified': '2024-09-17T04:35:04.121577+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4455, 'mds_1': 4437, 'mds_2': 4434}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4434': {'gid': 4434, 'name': 'c', 'rank': 2, 'incarnation': 12, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.43:6835/3276393888', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6833', 'nonce': 3276393888}, {'type': 'v1', 'addr': '172.21.15.43:6835', 'nonce': 3276393888}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4437': {'gid': 4437, 'name': 'e', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.43:6837/3935895854', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6836', 'nonce': 3935895854}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 3935895854}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4455': {'gid': 4455, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.62:6839/3263944095', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6838', 'nonce': 3263944095}, {'type': 'v1', 'addr': '172.21.15.62:6839', 'nonce': 3263944095}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4455, 'qdb_cluster': [4455, 4437]} 2024-09-17T04:35:09.313 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4434:up:creating 2024-09-17T04:35:10.314 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:35:10.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.446+0000 7fbf79ed5640 1 -- 172.21.15.43:0/2796719274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf740c6f00 msgr2=0x7fbf740d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:10.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.446+0000 7fbf79ed5640 1 --2- 172.21.15.43:0/2796719274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf740c6f00 0x7fbf740d15a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbf740cef00 tx=0x7fbf6402a560 comp rx=0 tx=0).stop 2024-09-17T04:35:10.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.446+0000 7fbf79ed5640 1 -- 172.21.15.43:0/2796719274 shutdown_connections 2024-09-17T04:35:10.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.446+0000 7fbf79ed5640 1 --2- 172.21.15.43:0/2796719274 >> v2:172.21.15.62:3300/0 conn(0x7fbf740c69b0 0x7fbf740d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:10.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.446+0000 7fbf79ed5640 1 --2- 172.21.15.43:0/2796719274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf740c6f00 0x7fbf740d15a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:10.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.446+0000 7fbf79ed5640 1 -- 172.21.15.43:0/2796719274 >> 172.21.15.43:0/2796719274 conn(0x7fbf7406f460 msgr2=0x7fbf7406f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:10.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.446+0000 7fbf79ed5640 1 -- 172.21.15.43:0/2796719274 shutdown_connections 2024-09-17T04:35:10.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.446+0000 7fbf79ed5640 1 -- 172.21.15.43:0/2796719274 wait complete. 2024-09-17T04:35:10.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.448+0000 7fbf79ed5640 1 Processor -- start 2024-09-17T04:35:10.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.448+0000 7fbf79ed5640 1 -- start start 2024-09-17T04:35:10.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.449+0000 7fbf79ed5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf740c69b0 0x7fbf7415d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:10.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.449+0000 7fbf79ed5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf740c6f00 0x7fbf741548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:10.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.449+0000 7fbf79ed5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf74155d40 0x7fbf740caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:10.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.449+0000 7fbf79ed5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbf740c7730 con 0x7fbf74155d40 2024-09-17T04:35:10.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.449+0000 7fbf79ed5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbf740c7450 con 0x7fbf740c69b0 2024-09-17T04:35:10.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.449+0000 7fbf79ed5640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fbf740b4d50 con 0x7fbf740c6f00 2024-09-17T04:35:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.450+0000 7fbf73fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf74155d40 0x7fbf740caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.450+0000 7fbf73fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf74155d40 0x7fbf740caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37056/0 (socket says 172.21.15.43:37056) 2024-09-17T04:35:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.450+0000 7fbf73fff640 1 -- 172.21.15.43:0/1778214891 learned_addr learned my addr 172.21.15.43:0/1778214891 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.450+0000 7fbf737fe640 1 --2- 172.21.15.43:0/1778214891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf740c69b0 0x7fbf7415d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.450+0000 7fbf72ffd640 1 --2- 172.21.15.43:0/1778214891 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf740c6f00 0x7fbf741548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.450+0000 7fbf73fff640 1 -- 172.21.15.43:0/1778214891 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf740c6f00 msgr2=0x7fbf741548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.450+0000 7fbf73fff640 1 --2- 172.21.15.43:0/1778214891 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf740c6f00 0x7fbf741548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.450+0000 7fbf73fff640 1 -- 172.21.15.43:0/1778214891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf740c69b0 msgr2=0x7fbf7415d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.450+0000 7fbf73fff640 1 --2- 172.21.15.43:0/1778214891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf740c69b0 0x7fbf7415d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.450+0000 7fbf73fff640 1 -- 172.21.15.43:0/1778214891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7415d610 con 0x7fbf74155d40 2024-09-17T04:35:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.450+0000 7fbf73fff640 1 --2- 172.21.15.43:0/1778214891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf74155d40 0x7fbf740caa70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00cae0 tx=0x7fbf6c007220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.450+0000 7fbf5bfff640 1 -- 172.21.15.43:0/1778214891 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c007da0 con 0x7fbf74155d40 2024-09-17T04:35:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.450+0000 7fbf5bfff640 1 -- 172.21.15.43:0/1778214891 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf6c004c30 con 0x7fbf74155d40 2024-09-17T04:35:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.450+0000 7fbf79ed5640 1 -- 172.21.15.43:0/1778214891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf7415ea50 con 0x7fbf74155d40 2024-09-17T04:35:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.450+0000 7fbf5bfff640 1 -- 172.21.15.43:0/1778214891 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c005280 con 0x7fbf74155d40 2024-09-17T04:35:10.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.450+0000 7fbf79ed5640 1 -- 172.21.15.43:0/1778214891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf741f2a60 con 0x7fbf74155d40 2024-09-17T04:35:10.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.451+0000 7fbf79ed5640 1 -- 172.21.15.43:0/1778214891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf740cc640 con 0x7fbf74155d40 2024-09-17T04:35:10.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.452+0000 7fbf5bfff640 1 -- 172.21.15.43:0/1778214891 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf6c005420 con 0x7fbf74155d40 2024-09-17T04:35:10.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.453+0000 7fbf5bfff640 1 --2- 172.21.15.43:0/1778214891 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fbf60078bc0 0x7fbf6007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:10.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.453+0000 7fbf5bfff640 1 -- 172.21.15.43:0/1778214891 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbf6c09b6b0 con 0x7fbf74155d40 2024-09-17T04:35:10.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.453+0000 7fbf737fe640 1 --2- 172.21.15.43:0/1778214891 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fbf60078bc0 0x7fbf6007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:10.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.454+0000 7fbf737fe640 1 --2- 172.21.15.43:0/1778214891 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fbf60078bc0 0x7fbf6007b0d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbf64033000 tx=0x7fbf64004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:10.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.457+0000 7fbf5bfff640 1 -- 172.21.15.43:0/1778214891 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbf6c014070 con 0x7fbf74155d40 2024-09-17T04:35:10.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.679+0000 7fbf79ed5640 1 -- 172.21.15.43:0/1778214891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf740b3d30 con 0x7fbf74155d40 2024-09-17T04:35:10.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.680+0000 7fbf5bfff640 1 -- 172.21.15.43:0/1778214891 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6896 (secure 0 0 0) 0x7fbf6c06c030 con 0x7fbf74155d40 2024-09-17T04:35:10.680 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:35:10.680 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":13,"btime":"2024-09-17T04:35:09:138823+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/424910095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6835","nonce":424910095},{"type":"v1","addr":"172.21.15.62:6837","nonce":424910095}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6836/882111784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":882111784},{"type":"v1","addr":"172.21.15.62:6836","nonce":882111784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4431,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/47250523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":47250523},{"type":"v1","addr":"172.21.15.43:6834","nonce":47250523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:34:51.443546+0000","modified":"2024-09-17T04:35:09.138815+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4455,"mds_1":4437,"mds_2":4434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4434":{"gid":4434,"name":"c","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6835/3276393888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":3276393888},{"type":"v1","addr":"172.21.15.43:6835","nonce":3276393888}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4437":{"gid":4437,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.43:6837/3935895854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":3935895854},{"type":"v1","addr":"172.21.15.43:6837","nonce":3935895854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4455":{"gid":4455,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6839/3263944095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3263944095},{"type":"v1","addr":"172.21.15.62:6839","nonce":3263944095}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4455,"qdb_cluster":[4434,4437,4455]},"id":1}]} 2024-09-17T04:35:10.681 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 13 2024-09-17T04:35:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.682+0000 7fbf79ed5640 1 -- 172.21.15.43:0/1778214891 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fbf60078bc0 msgr2=0x7fbf6007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.682+0000 7fbf79ed5640 1 --2- 172.21.15.43:0/1778214891 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fbf60078bc0 0x7fbf6007b0d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbf64033000 tx=0x7fbf64004730 comp rx=0 tx=0).stop 2024-09-17T04:35:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.682+0000 7fbf79ed5640 1 -- 172.21.15.43:0/1778214891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf74155d40 msgr2=0x7fbf740caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.682+0000 7fbf79ed5640 1 --2- 172.21.15.43:0/1778214891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf74155d40 0x7fbf740caa70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00cae0 tx=0x7fbf6c007220 comp rx=0 tx=0).stop 2024-09-17T04:35:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.683+0000 7fbf79ed5640 1 -- 172.21.15.43:0/1778214891 shutdown_connections 2024-09-17T04:35:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.683+0000 7fbf79ed5640 1 --2- 172.21.15.43:0/1778214891 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fbf60078bc0 0x7fbf6007b0d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.683+0000 7fbf79ed5640 1 --2- 172.21.15.43:0/1778214891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf74155d40 0x7fbf740caa70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.683+0000 7fbf79ed5640 1 --2- 172.21.15.43:0/1778214891 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf740c6f00 0x7fbf741548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.683+0000 7fbf79ed5640 1 --2- 172.21.15.43:0/1778214891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf740c69b0 0x7fbf7415d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.683+0000 7fbf79ed5640 1 -- 172.21.15.43:0/1778214891 >> 172.21.15.43:0/1778214891 conn(0x7fbf7406f460 msgr2=0x7fbf740cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.683+0000 7fbf79ed5640 1 -- 172.21.15.43:0/1778214891 shutdown_connections 2024-09-17T04:35:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:10.683+0000 7fbf79ed5640 1 -- 172.21.15.43:0/1778214891 wait complete. 2024-09-17T04:35:11.297 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T04:34:51.443546+0000', 'modified': '2024-09-17T04:35:09.138815+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4455, 'mds_1': 4437, 'mds_2': 4434}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4434': {'gid': 4434, 'name': 'c', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.43:6835/3276393888', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6833', 'nonce': 3276393888}, {'type': 'v1', 'addr': '172.21.15.43:6835', 'nonce': 3276393888}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4437': {'gid': 4437, 'name': 'e', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.43:6837/3935895854', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6836', 'nonce': 3935895854}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 3935895854}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4455': {'gid': 4455, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.62:6839/3263944095', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6838', 'nonce': 3263944095}, {'type': 'v1', 'addr': '172.21.15.62:6839', 'nonce': 3263944095}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4455, 'qdb_cluster': [4434, 4437, 4455]} 2024-09-17T04:35:11.298 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-17T04:35:11.298 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T04:35:11.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.425+0000 7f1bf4d69640 1 -- 172.21.15.43:0/1876235805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bf00ccd60 msgr2=0x7f1bf00ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:11.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.425+0000 7f1bf4d69640 1 --2- 172.21.15.43:0/1876235805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bf00ccd60 0x7f1bf00ce0a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1be8005fd0 tx=0x7f1be802aa10 comp rx=0 tx=0).stop 2024-09-17T04:35:11.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.425+0000 7f1bf4d69640 1 -- 172.21.15.43:0/1876235805 shutdown_connections 2024-09-17T04:35:11.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.425+0000 7f1bf4d69640 1 --2- 172.21.15.43:0/1876235805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bf00ccd60 0x7f1bf00ce0a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:11.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.425+0000 7f1bf4d69640 1 --2- 172.21.15.43:0/1876235805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bf00b4db0 0x7f1bf00caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:11.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.425+0000 7f1bf4d69640 1 -- 172.21.15.43:0/1876235805 >> 172.21.15.43:0/1876235805 conn(0x7f1bf006f4e0 msgr2=0x7f1bf006f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:11.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.425+0000 7f1bf4d69640 1 -- 172.21.15.43:0/1876235805 shutdown_connections 2024-09-17T04:35:11.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.425+0000 7f1bf4d69640 1 -- 172.21.15.43:0/1876235805 wait complete. 2024-09-17T04:35:11.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.427+0000 7f1bf4d69640 1 Processor -- start 2024-09-17T04:35:11.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.427+0000 7f1bf4d69640 1 -- start start 2024-09-17T04:35:11.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.428+0000 7f1bf4d69640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bf00b4db0 0x7f1bf0156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:11.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bf4d69640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bf00ccd60 0x7f1bf00cf630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:11.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bf4d69640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1bf00cd670 0x7f1bf00d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:11.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bf4d69640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf00b5ab0 con 0x7f1bf00ccd60 2024-09-17T04:35:11.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bf4d69640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf00b57d0 con 0x7f1bf00cd670 2024-09-17T04:35:11.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bf4d69640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf00cb440 con 0x7f1bf00b4db0 2024-09-17T04:35:11.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bedd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bf00ccd60 0x7f1bf00cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:11.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bedd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bf00ccd60 0x7f1bf00cf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37078/0 (socket says 172.21.15.43:37078) 2024-09-17T04:35:11.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bedd9b640 1 -- 172.21.15.43:0/506752588 learned_addr learned my addr 172.21.15.43:0/506752588 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:11.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bee59c640 1 --2- 172.21.15.43:0/506752588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bf00b4db0 0x7f1bf0156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:11.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1beed9d640 1 --2- 172.21.15.43:0/506752588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1bf00cd670 0x7f1bf00d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:11.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bedd9b640 1 -- 172.21.15.43:0/506752588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bf00b4db0 msgr2=0x7f1bf0156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:11.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bedd9b640 1 --2- 172.21.15.43:0/506752588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bf00b4db0 0x7f1bf0156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:11.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bedd9b640 1 -- 172.21.15.43:0/506752588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1bf00cd670 msgr2=0x7f1bf00d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:11.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bedd9b640 1 --2- 172.21.15.43:0/506752588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1bf00cd670 0x7f1bf00d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:11.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bedd9b640 1 -- 172.21.15.43:0/506752588 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf0154340 con 0x7f1bf00ccd60 2024-09-17T04:35:11.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bedd9b640 1 --2- 172.21.15.43:0/506752588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bf00ccd60 0x7f1bf00cf630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1be400c370 tx=0x7f1be400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:11.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bdeffd640 1 -- 172.21.15.43:0/506752588 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be4017070 con 0x7f1bf00ccd60 2024-09-17T04:35:11.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bdeffd640 1 -- 172.21.15.43:0/506752588 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1be40035f0 con 0x7f1bf00ccd60 2024-09-17T04:35:11.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bf4d69640 1 -- 172.21.15.43:0/506752588 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf00cfb70 con 0x7f1bf00ccd60 2024-09-17T04:35:11.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bdeffd640 1 -- 172.21.15.43:0/506752588 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be4003a40 con 0x7f1bf00ccd60 2024-09-17T04:35:11.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.429+0000 7f1bf4d69640 1 -- 172.21.15.43:0/506752588 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf0154060 con 0x7f1bf00ccd60 2024-09-17T04:35:11.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.431+0000 7f1bdeffd640 1 -- 172.21.15.43:0/506752588 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1be401a070 con 0x7f1bf00ccd60 2024-09-17T04:35:11.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.432+0000 7f1bdeffd640 1 --2- 172.21.15.43:0/506752588 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1bd0078bc0 0x7f1bd007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:11.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.432+0000 7f1bdeffd640 1 -- 172.21.15.43:0/506752588 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1be4099db0 con 0x7f1bf00ccd60 2024-09-17T04:35:11.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.432+0000 7f1bee59c640 1 --2- 172.21.15.43:0/506752588 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1bd0078bc0 0x7f1bd007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:11.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.433+0000 7f1bfbcda740 1 Processor -- start 2024-09-17T04:35:11.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.433+0000 7f1bee59c640 1 --2- 172.21.15.43:0/506752588 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1bd0078bc0 0x7f1bd007b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1be000bb50 tx=0x7f1be000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:11.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.433+0000 7f1bfbcda740 1 -- start start 2024-09-17T04:35:11.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.434+0000 7f1bfbcda740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cf1270 0x55c1c70dd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:11.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.434+0000 7f1bfbcda740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cc83b0 0x55c1c7093940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:11.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.434+0000 7f1bfbcda740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cd0590 0x55c1c7098b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:11.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.434+0000 7f1bfbcda740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c1c700b820 con 0x55c1c6cc83b0 2024-09-17T04:35:11.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.434+0000 7f1bfbcda740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c1c6ffac50 con 0x55c1c6cf1270 2024-09-17T04:35:11.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.434+0000 7f1bfbcda740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55c1c6ffea60 con 0x55c1c6cd0590 2024-09-17T04:35:11.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.434+0000 7f1bedd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cc83b0 0x55c1c7093940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:11.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.434+0000 7f1bedd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cc83b0 0x55c1c7093940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37086/0 (socket says 172.21.15.43:37086) 2024-09-17T04:35:11.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.434+0000 7f1bedd9b640 1 -- 172.21.15.43:0/4077929665 learned_addr learned my addr 172.21.15.43:0/4077929665 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:11.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.434+0000 7f1bee59c640 1 --2- 172.21.15.43:0/4077929665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cf1270 0x55c1c70dd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:11.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.434+0000 7f1beed9d640 1 --2- 172.21.15.43:0/4077929665 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cd0590 0x55c1c7098b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:11.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.435+0000 7f1bedd9b640 1 -- 172.21.15.43:0/4077929665 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cd0590 msgr2=0x55c1c7098b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:11.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.435+0000 7f1bedd9b640 1 --2- 172.21.15.43:0/4077929665 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cd0590 0x55c1c7098b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:11.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.435+0000 7f1bedd9b640 1 -- 172.21.15.43:0/4077929665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cf1270 msgr2=0x55c1c70dd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:11.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.435+0000 7f1bedd9b640 1 --2- 172.21.15.43:0/4077929665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cf1270 0x55c1c70dd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:11.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.435+0000 7f1bedd9b640 1 -- 172.21.15.43:0/4077929665 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1c6d5c850 con 0x55c1c6cc83b0 2024-09-17T04:35:11.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.435+0000 7f1bedd9b640 1 --2- 172.21.15.43:0/4077929665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cc83b0 0x55c1c7093940 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1be4098300 tx=0x7f1be4061650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb652ee4f2418a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:11.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.435+0000 7f1bcffff640 1 -- 172.21.15.43:0/4077929665 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be4066660 con 0x55c1c6cc83b0 2024-09-17T04:35:11.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.435+0000 7f1bcffff640 1 -- 172.21.15.43:0/4077929665 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1be406b510 con 0x55c1c6cc83b0 2024-09-17T04:35:11.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.435+0000 7f1bcffff640 1 -- 172.21.15.43:0/4077929665 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be406b2e0 con 0x55c1c6cc83b0 2024-09-17T04:35:11.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.436+0000 7f1bfbcda740 1 -- 172.21.15.43:0/4077929665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cc83b0 msgr2=0x55c1c7093940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:11.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.436+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/4077929665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cc83b0 0x55c1c7093940 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1be4098300 tx=0x7f1be4061650 comp rx=0 tx=0).stop 2024-09-17T04:35:11.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.436+0000 7f1bfbcda740 1 -- 172.21.15.43:0/4077929665 shutdown_connections 2024-09-17T04:35:11.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.436+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/4077929665 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cd0590 0x55c1c7098b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:11.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.436+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/4077929665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cc83b0 0x55c1c7093940 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:11.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.436+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/4077929665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cf1270 0x55c1c70dd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:11.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.436+0000 7f1bfbcda740 1 -- 172.21.15.43:0/4077929665 >> 172.21.15.43:0/4077929665 conn(0x55c1c6ce53c0 msgr2=0x55c1c70dc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:11.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.436+0000 7f1bfbcda740 1 -- 172.21.15.43:0/4077929665 shutdown_connections 2024-09-17T04:35:11.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.436+0000 7f1bfbcda740 1 -- 172.21.15.43:0/4077929665 wait complete. 2024-09-17T04:35:11.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.437+0000 7f1bfbcda740 1 -- start start 2024-09-17T04:35:11.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.437+0000 7f1bfbcda740 1 Processor -- start 2024-09-17T04:35:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.438+0000 7f1bfbcda740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cc83b0 0x55c1c70d5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.438+0000 7f1bfbcda740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cd0590 0x55c1c70ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.438+0000 7f1bfbcda740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.438+0000 7f1bfbcda740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c1c6d6b620 con 0x55c1c6cf1270 2024-09-17T04:35:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.438+0000 7f1bfbcda740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c1c6fa05f0 con 0x55c1c6cd0590 2024-09-17T04:35:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.438+0000 7f1bfbcda740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55c1c70ec100 con 0x55c1c6cc83b0 2024-09-17T04:35:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.438+0000 7f1beed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.438+0000 7f1bfbcda740 10 client.0 _ll_register_callbacks cb 0x55c1c6fa40a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T04:35:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.438+0000 7f1beed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37100/0 (socket says 172.21.15.43:37100) 2024-09-17T04:35:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.438+0000 7f1beed9d640 1 -- 172.21.15.43:0/165203950 learned_addr learned my addr 172.21.15.43:0/165203950 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.438+0000 7f1bedd9b640 1 --2- 172.21.15.43:0/165203950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cd0590 0x55c1c70ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:11.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.438+0000 7f1bee59c640 1 --2- 172.21.15.43:0/165203950 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cc83b0 0x55c1c70d5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:11.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.439+0000 7f1beed9d640 1 -- 172.21.15.43:0/165203950 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cc83b0 msgr2=0x55c1c70d5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:11.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.439+0000 7f1beed9d640 1 --2- 172.21.15.43:0/165203950 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cc83b0 0x55c1c70d5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:11.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.439+0000 7f1beed9d640 1 -- 172.21.15.43:0/165203950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cd0590 msgr2=0x55c1c70ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:11.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.439+0000 7f1beed9d640 1 --2- 172.21.15.43:0/165203950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cd0590 0x55c1c70ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:11.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.439+0000 7f1beed9d640 1 -- 172.21.15.43:0/165203950 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1c6dd36b0 con 0x55c1c6cf1270 2024-09-17T04:35:11.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.439+0000 7f1beed9d640 1 --2- 172.21.15.43:0/165203950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70cd0b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1be802b000 tx=0x7f1be8003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24572fdb1ee4d8a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:11.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.439+0000 7f1bcd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-17T04:35:11.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.439+0000 7f1bcd7fa640 1 -- 172.21.15.43:0/165203950 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be8048060 con 0x55c1c6cf1270 2024-09-17T04:35:11.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.439+0000 7f1bcd7fa640 1 -- 172.21.15.43:0/165203950 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1be8004240 con 0x55c1c6cf1270 2024-09-17T04:35:11.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.439+0000 7f1bfbcda740 1 -- 172.21.15.43:0/165203950 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1be406b510 con 0x55c1c6cf1270 2024-09-17T04:35:11.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.439+0000 7f1bcd7fa640 1 -- 172.21.15.43:0/165203950 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f1be804e050 con 0x55c1c6cf1270 2024-09-17T04:35:11.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.439+0000 7f1bfbcda740 10 client.4794 fetch_fsmap learned FSMap version 13 2024-09-17T04:35:11.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.439+0000 7f1bfbcda740 1 -- 172.21.15.43:0/165203950 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55c1c70d27f0 con 0x55c1c6cf1270 2024-09-17T04:35:11.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.439+0000 7f1bcd7fa640 1 -- 172.21.15.43:0/165203950 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1be406b510 con 0x55c1c6cf1270 2024-09-17T04:35:11.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.440+0000 7f1bcd7fa640 1 -- 172.21.15.43:0/165203950 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 13) ==== 4752+0+0 (secure 0 0 0) 0x7f1be8051020 con 0x55c1c6cf1270 2024-09-17T04:35:11.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.440+0000 7f1bfbcda740 10 client.4794 fetch_fsmap finished waiting for FSMap version 13 2024-09-17T04:35:11.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.440+0000 7f1bfbcda740 10 client.4794 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T04:35:11.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.440+0000 7f1bfbcda740 20 client.4794 populate_metadata read hostname 'smithi043' 2024-09-17T04:35:11.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.440+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/165203950 >> [v2:172.21.15.43:6833/3276393888,v1:172.21.15.43:6835/3276393888] conn(0x55c1c6cafe40 0x55c1c70f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:11.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.440+0000 7f1bfbcda740 4 client.4794 mds_command: new command op to 4434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T04:35:11.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.440+0000 7f1bfbcda740 1 -- 172.21.15.43:0/165203950 --> [v2:172.21.15.43:6833/3276393888,v1:172.21.15.43:6835/3276393888] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1c700d770 con 0x55c1c6cafe40 2024-09-17T04:35:11.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.440+0000 7f1bee59c640 1 --2- 172.21.15.43:0/165203950 >> [v2:172.21.15.43:6833/3276393888,v1:172.21.15.43:6835/3276393888] conn(0x55c1c6cafe40 0x55c1c70f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:11.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.440+0000 7f1bcd7fa640 10 client.4794 ms_handle_connect on v2:172.21.15.43:6833/3276393888 2024-09-17T04:35:11.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:11.440+0000 7f1bee59c640 1 --2- 172.21.15.43:0/165203950 >> [v2:172.21.15.43:6833/3276393888,v1:172.21.15.43:6835/3276393888] conn(0x55c1c6cafe40 0x55c1c70f72b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4bf190cd90ee5866 server_cookie=891c11c87f3915a4 in_seq=0 out_seq=0 2024-09-17T04:35:12.039 INFO:tasks.ceph.mds.f.smithi062.stderr:2024-09-17T04:35:12.039+0000 7f92a527c640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-17T04:35:14.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.144+0000 7f1bcd7fa640 1 -- 172.21.15.43:0/165203950 <== mds.2 v2:172.21.15.43:6833/3276393888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c1c700d770 con 0x55c1c6cafe40 2024-09-17T04:35:14.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.144+0000 7f1bcd7fa640 10 client.4794 handle_command_reply: tid=0 2024-09-17T04:35:14.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.144+0000 7f1bfbcda740 1 client.4794 shutdown 2024-09-17T04:35:14.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.145+0000 7f1bfbcda740 1 -- 172.21.15.43:0/165203950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 msgr2=0x55c1c70cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.145+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/165203950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70cd0b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1be802b000 tx=0x7f1be8003eb0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.145+0000 7f1bfbcda740 1 -- 172.21.15.43:0/165203950 shutdown_connections 2024-09-17T04:35:14.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.145+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/165203950 >> [v2:172.21.15.43:6833/3276393888,v1:172.21.15.43:6835/3276393888] conn(0x55c1c6cafe40 0x55c1c70f72b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.145+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/165203950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cd0590 0x55c1c70ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.145+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/165203950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70cd0b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.145+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/165203950 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cc83b0 0x55c1c70d5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.145+0000 7f1bcd7fa640 0 client.4794 ms_handle_reset on v2:172.21.15.43:6833/3276393888 2024-09-17T04:35:14.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.145+0000 7f1bfbcda740 1 -- 172.21.15.43:0/165203950 >> 172.21.15.43:0/165203950 conn(0x55c1c6ce53c0 msgr2=0x55c1c70dc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:14.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.145+0000 7f1bfbcda740 1 -- 172.21.15.43:0/165203950 shutdown_connections 2024-09-17T04:35:14.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.145+0000 7f1bfbcda740 1 -- 172.21.15.43:0/165203950 wait complete. 2024-09-17T04:35:14.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.145+0000 7f1bfbcda740 20 client.4794 trim_cache size 0 max 16384 2024-09-17T04:35:14.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.166+0000 7f1bfbcda740 1 Processor -- start 2024-09-17T04:35:14.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.166+0000 7f1bfbcda740 1 -- start start 2024-09-17T04:35:14.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.167+0000 7f1bfbcda740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cc83b0 0x55c1c7094fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.167+0000 7f1bfbcda740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cd0590 0x55c1c70dc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.167+0000 7f1bfbcda740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70dc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.167+0000 7f1bfbcda740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf01f5c80 con 0x55c1c6cf1270 2024-09-17T04:35:14.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.167+0000 7f1bfbcda740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c1c7094420 con 0x55c1c6cc83b0 2024-09-17T04:35:14.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.167+0000 7f1bfbcda740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55c1c70d2de0 con 0x55c1c6cd0590 2024-09-17T04:35:14.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.167+0000 7f1beed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70dc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.167+0000 7f1beed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70dc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37104/0 (socket says 172.21.15.43:37104) 2024-09-17T04:35:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.167+0000 7f1beed9d640 1 -- 172.21.15.43:0/144298583 learned_addr learned my addr 172.21.15.43:0/144298583 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.168+0000 7f1bedd9b640 1 --2- 172.21.15.43:0/144298583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cd0590 0x55c1c70dc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.168+0000 7f1bee59c640 1 --2- 172.21.15.43:0/144298583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cc83b0 0x55c1c7094fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.168+0000 7f1beed9d640 1 -- 172.21.15.43:0/144298583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cd0590 msgr2=0x55c1c70dc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.168+0000 7f1beed9d640 1 --2- 172.21.15.43:0/144298583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cd0590 0x55c1c70dc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.168+0000 7f1beed9d640 1 -- 172.21.15.43:0/144298583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cc83b0 msgr2=0x55c1c7094fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.168+0000 7f1beed9d640 1 --2- 172.21.15.43:0/144298583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cc83b0 0x55c1c7094fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.168+0000 7f1beed9d640 1 -- 172.21.15.43:0/144298583 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1c7097500 con 0x55c1c6cf1270 2024-09-17T04:35:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.168+0000 7f1bedd9b640 1 --2- 172.21.15.43:0/144298583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cd0590 0x55c1c70dc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:35:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.168+0000 7f1bee59c640 1 --2- 172.21.15.43:0/144298583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cc83b0 0x55c1c7094fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:35:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.168+0000 7f1beed9d640 1 --2- 172.21.15.43:0/144298583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70dc8c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1be8003d50 tx=0x7f1be8004650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cca93675bfeee61 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.168+0000 7f1bcf7fe640 1 -- 172.21.15.43:0/144298583 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be8033040 con 0x55c1c6cf1270 2024-09-17T04:35:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.168+0000 7f1bcf7fe640 1 -- 172.21.15.43:0/144298583 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1be8009800 con 0x55c1c6cf1270 2024-09-17T04:35:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.168+0000 7f1bcf7fe640 1 -- 172.21.15.43:0/144298583 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be8004180 con 0x55c1c6cf1270 2024-09-17T04:35:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.169+0000 7f1bfbcda740 1 -- 172.21.15.43:0/144298583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 msgr2=0x55c1c70dc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.169+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/144298583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70dc8c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1be8003d50 tx=0x7f1be8004650 comp rx=0 tx=0).stop 2024-09-17T04:35:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.169+0000 7f1bfbcda740 1 -- 172.21.15.43:0/144298583 shutdown_connections 2024-09-17T04:35:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.169+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/144298583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70dc8c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.169+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/144298583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cd0590 0x55c1c70dc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.169+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/144298583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cc83b0 0x55c1c7094fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.169+0000 7f1bfbcda740 1 -- 172.21.15.43:0/144298583 >> 172.21.15.43:0/144298583 conn(0x55c1c6ce53c0 msgr2=0x55c1c70ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:14.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.169+0000 7f1bfbcda740 1 -- 172.21.15.43:0/144298583 shutdown_connections 2024-09-17T04:35:14.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.169+0000 7f1bfbcda740 1 -- 172.21.15.43:0/144298583 wait complete. 2024-09-17T04:35:14.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.170+0000 7f1bfbcda740 1 -- start start 2024-09-17T04:35:14.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.171+0000 7f1bfbcda740 1 Processor -- start 2024-09-17T04:35:14.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.172+0000 7f1bfbcda740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cc83b0 0x55c1c70ec7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.172+0000 7f1bfbcda740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cd0590 0x55c1c714fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.172+0000 7f1bfbcda740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70ed900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.172+0000 7f1bfbcda740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c1c70d6490 con 0x55c1c6cf1270 2024-09-17T04:35:14.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.172+0000 7f1bfbcda740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c1c70e92a0 con 0x55c1c6cd0590 2024-09-17T04:35:14.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.172+0000 7f1bfbcda740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55c1c7092580 con 0x55c1c6cc83b0 2024-09-17T04:35:14.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.172+0000 7f1bfbcda740 10 client.0 _ll_register_callbacks cb 0x7f1be8003de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T04:35:14.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.172+0000 7f1beed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70ed900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.172+0000 7f1bee59c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cc83b0 0x55c1c70ec7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.172+0000 7f1beed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70ed900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37116/0 (socket says 172.21.15.43:37116) 2024-09-17T04:35:14.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.172+0000 7f1bee59c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cc83b0 0x55c1c70ec7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:33926/0 (socket says 172.21.15.43:33926) 2024-09-17T04:35:14.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.172+0000 7f1beed9d640 1 -- 172.21.15.43:0/3505757331 learned_addr learned my addr 172.21.15.43:0/3505757331 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:14.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.172+0000 7f1bedd9b640 1 --2- 172.21.15.43:0/3505757331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cd0590 0x55c1c714fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.173+0000 7f1beed9d640 1 -- 172.21.15.43:0/3505757331 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cc83b0 msgr2=0x55c1c70ec7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.173+0000 7f1beed9d640 1 --2- 172.21.15.43:0/3505757331 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cc83b0 0x55c1c70ec7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.173+0000 7f1beed9d640 1 -- 172.21.15.43:0/3505757331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cd0590 msgr2=0x55c1c714fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.173+0000 7f1beed9d640 1 --2- 172.21.15.43:0/3505757331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cd0590 0x55c1c714fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.173+0000 7f1beed9d640 1 -- 172.21.15.43:0/3505757331 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1c70ecce0 con 0x55c1c6cf1270 2024-09-17T04:35:14.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.173+0000 7f1beed9d640 1 --2- 172.21.15.43:0/3505757331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70ed900 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1be8009bf0 tx=0x7f1be8005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40780f9d92b364c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:14.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.173+0000 7f1bcd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-17T04:35:14.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.173+0000 7f1bcd7fa640 1 -- 172.21.15.43:0/3505757331 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be8033070 con 0x55c1c6cf1270 2024-09-17T04:35:14.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.173+0000 7f1bcd7fa640 1 -- 172.21.15.43:0/3505757331 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1be803a6f0 con 0x55c1c6cf1270 2024-09-17T04:35:14.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.173+0000 7f1bfbcda740 1 -- 172.21.15.43:0/3505757331 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1be8009800 con 0x55c1c6cf1270 2024-09-17T04:35:14.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.173+0000 7f1bcd7fa640 1 -- 172.21.15.43:0/3505757331 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f1be8068050 con 0x55c1c6cf1270 2024-09-17T04:35:14.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.173+0000 7f1bfbcda740 10 client.4800 fetch_fsmap learned FSMap version 13 2024-09-17T04:35:14.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.173+0000 7f1bfbcda740 1 -- 172.21.15.43:0/3505757331 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55c1c70936f0 con 0x55c1c6cf1270 2024-09-17T04:35:14.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.174+0000 7f1bcd7fa640 1 -- 172.21.15.43:0/3505757331 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1be8009800 con 0x55c1c6cf1270 2024-09-17T04:35:14.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.174+0000 7f1bcd7fa640 1 -- 172.21.15.43:0/3505757331 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 13) ==== 4752+0+0 (secure 0 0 0) 0x7f1be806b020 con 0x55c1c6cf1270 2024-09-17T04:35:14.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.174+0000 7f1bfbcda740 10 client.4800 fetch_fsmap finished waiting for FSMap version 13 2024-09-17T04:35:14.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.174+0000 7f1bfbcda740 10 client.4800 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T04:35:14.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.174+0000 7f1bfbcda740 20 client.4800 populate_metadata read hostname 'smithi043' 2024-09-17T04:35:14.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.174+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/3505757331 >> [v2:172.21.15.43:6833/3276393888,v1:172.21.15.43:6835/3276393888] conn(0x55c1c70cefe0 0x55c1c7165c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.174+0000 7f1bfbcda740 4 client.4800 mds_command: new command op to 4434 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T04:35:14.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.174+0000 7f1bfbcda740 1 -- 172.21.15.43:0/3505757331 --> [v2:172.21.15.43:6833/3276393888,v1:172.21.15.43:6835/3276393888] -- command(tid 0: {"prefix": "status"}) -- 0x55c1c70cda70 con 0x55c1c70cefe0 2024-09-17T04:35:14.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.174+0000 7f1bee59c640 1 --2- 172.21.15.43:0/3505757331 >> [v2:172.21.15.43:6833/3276393888,v1:172.21.15.43:6835/3276393888] conn(0x55c1c70cefe0 0x55c1c7165c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.175+0000 7f1bcd7fa640 10 client.4800 ms_handle_connect on v2:172.21.15.43:6833/3276393888 2024-09-17T04:35:14.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.175+0000 7f1bee59c640 1 --2- 172.21.15.43:0/3505757331 >> [v2:172.21.15.43:6833/3276393888,v1:172.21.15.43:6835/3276393888] conn(0x55c1c70cefe0 0x55c1c7165c20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9f0aac706f57e5f server_cookie=b52df287e2667a59 in_seq=0 out_seq=0 2024-09-17T04:35:14.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.175+0000 7f1bcd7fa640 1 -- 172.21.15.43:0/3505757331 <== mds.2 v2:172.21.15.43:6833/3276393888 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55c1c70cda70 con 0x55c1c70cefe0 2024-09-17T04:35:14.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.175+0000 7f1bcd7fa640 10 client.4800 handle_command_reply: tid=0 2024-09-17T04:35:14.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.175+0000 7f1bfbcda740 1 client.4800 shutdown 2024-09-17T04:35:14.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.175+0000 7f1bfbcda740 1 -- 172.21.15.43:0/3505757331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 msgr2=0x55c1c70ed900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.175+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/3505757331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70ed900 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1be8009bf0 tx=0x7f1be8005cf0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.175+0000 7f1bfbcda740 1 -- 172.21.15.43:0/3505757331 shutdown_connections 2024-09-17T04:35:14.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.175+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/3505757331 >> [v2:172.21.15.43:6833/3276393888,v1:172.21.15.43:6835/3276393888] conn(0x55c1c70cefe0 0x55c1c7165c20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.175+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/3505757331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c1c6cd0590 0x55c1c714fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.175+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/3505757331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c6cf1270 0x55c1c70ed900 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.175+0000 7f1bfbcda740 1 --2- 172.21.15.43:0/3505757331 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c1c6cc83b0 0x55c1c70ec7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.175+0000 7f1bcd7fa640 0 client.4800 ms_handle_reset on v2:172.21.15.43:6833/3276393888 2024-09-17T04:35:14.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.175+0000 7f1bfbcda740 1 -- 172.21.15.43:0/3505757331 >> 172.21.15.43:0/3505757331 conn(0x55c1c6ce53c0 msgr2=0x55c1c709a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:14.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.175+0000 7f1bfbcda740 1 -- 172.21.15.43:0/3505757331 shutdown_connections 2024-09-17T04:35:14.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.175+0000 7f1bfbcda740 1 -- 172.21.15.43:0/3505757331 wait complete. 2024-09-17T04:35:14.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.175+0000 7f1bfbcda740 20 client.4800 trim_cache size 0 max 16384 2024-09-17T04:35:14.185 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-17T04:35:14.185 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "cdef1e3e-07e6-43e6-b635-3ed1bc15d64a", 2024-09-17T04:35:14.185 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 2, 2024-09-17T04:35:14.185 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4434, 2024-09-17T04:35:14.185 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-09-17T04:35:14.185 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-09-17T04:35:14.185 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-09-17T04:35:14.185 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 10.051197947, 2024-09-17T04:35:14.186 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 13, 2024-09-17T04:35:14.186 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 22, 2024-09-17T04:35:14.186 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 22, 2024-09-17T04:35:14.186 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 28.153198619000001 2024-09-17T04:35:14.186 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-17T04:35:14.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.176+0000 7f1bf4d69640 1 -- 172.21.15.43:0/506752588 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1bd0078bc0 msgr2=0x7f1bd007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.176+0000 7f1bf4d69640 1 --2- 172.21.15.43:0/506752588 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1bd0078bc0 0x7f1bd007b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1be000bb50 tx=0x7f1be000b2e0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.176+0000 7f1bf4d69640 1 -- 172.21.15.43:0/506752588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bf00ccd60 msgr2=0x7f1bf00cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.176+0000 7f1bf4d69640 1 --2- 172.21.15.43:0/506752588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bf00ccd60 0x7f1bf00cf630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1be400c370 tx=0x7f1be400c830 comp rx=0 tx=0).stop 2024-09-17T04:35:14.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.176+0000 7f1bf4d69640 1 -- 172.21.15.43:0/506752588 shutdown_connections 2024-09-17T04:35:14.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.176+0000 7f1bf4d69640 1 --2- 172.21.15.43:0/506752588 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f1bd0078bc0 0x7f1bd007b0d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.176+0000 7f1bf4d69640 1 --2- 172.21.15.43:0/506752588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1bf00cd670 0x7f1bf00d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.176+0000 7f1bf4d69640 1 --2- 172.21.15.43:0/506752588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bf00ccd60 0x7f1bf00cf630 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.176+0000 7f1bf4d69640 1 --2- 172.21.15.43:0/506752588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bf00b4db0 0x7f1bf0156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.176+0000 7f1bf4d69640 1 -- 172.21.15.43:0/506752588 >> 172.21.15.43:0/506752588 conn(0x7f1bf006f4e0 msgr2=0x7f1bf00c9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:14.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.176+0000 7f1bf4d69640 1 -- 172.21.15.43:0/506752588 shutdown_connections 2024-09-17T04:35:14.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.176+0000 7f1bf4d69640 1 -- 172.21.15.43:0/506752588 wait complete. 2024-09-17T04:35:14.190 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-09-17T04:35:14.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.315+0000 7f576200e640 1 -- 172.21.15.43:0/4226029950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f575c1538e0 msgr2=0x7f575c0723d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.315+0000 7f576200e640 1 --2- 172.21.15.43:0/4226029950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f575c1538e0 0x7f575c0723d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5750009830 tx=0x7f575002a5a0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.315+0000 7f576200e640 1 -- 172.21.15.43:0/4226029950 shutdown_connections 2024-09-17T04:35:14.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.315+0000 7f576200e640 1 --2- 172.21.15.43:0/4226029950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f575c1538e0 0x7f575c0723d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.315+0000 7f576200e640 1 --2- 172.21.15.43:0/4226029950 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f575c0cb490 0x7f575c0c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.315+0000 7f576200e640 1 -- 172.21.15.43:0/4226029950 >> 172.21.15.43:0/4226029950 conn(0x7f575c0cefa0 msgr2=0x7f575c0cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:14.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.315+0000 7f576200e640 1 -- 172.21.15.43:0/4226029950 shutdown_connections 2024-09-17T04:35:14.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.315+0000 7f576200e640 1 -- 172.21.15.43:0/4226029950 wait complete. 2024-09-17T04:35:14.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.317+0000 7f576200e640 1 Processor -- start 2024-09-17T04:35:14.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.317+0000 7f576200e640 1 -- start start 2024-09-17T04:35:14.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.318+0000 7f576200e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f575c072910 0x7f575c14d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.318+0000 7f576200e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f575c0cb490 0x7f575c1477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f576200e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f575c1538e0 0x7f575c147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f576200e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f575c153cf0 con 0x7f575c0cb490 2024-09-17T04:35:14.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f576200e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f575c071e00 con 0x7f575c072910 2024-09-17T04:35:14.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f576200e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f575c0719e0 con 0x7f575c1538e0 2024-09-17T04:35:14.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f575affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f575c0cb490 0x7f575c1477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f575affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f575c0cb490 0x7f575c1477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37134/0 (socket says 172.21.15.43:37134) 2024-09-17T04:35:14.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f575affd640 1 -- 172.21.15.43:0/3525159535 learned_addr learned my addr 172.21.15.43:0/3525159535 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:14.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f575bfff640 1 --2- 172.21.15.43:0/3525159535 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f575c1538e0 0x7f575c147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f575b7fe640 1 --2- 172.21.15.43:0/3525159535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f575c072910 0x7f575c14d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f575affd640 1 -- 172.21.15.43:0/3525159535 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f575c1538e0 msgr2=0x7f575c147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f575affd640 1 --2- 172.21.15.43:0/3525159535 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f575c1538e0 0x7f575c147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f575affd640 1 -- 172.21.15.43:0/3525159535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f575c072910 msgr2=0x7f575c14d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f575affd640 1 --2- 172.21.15.43:0/3525159535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f575c072910 0x7f575c14d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f575affd640 1 -- 172.21.15.43:0/3525159535 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c0c84f0 con 0x7f575c0cb490 2024-09-17T04:35:14.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f575b7fe640 1 --2- 172.21.15.43:0/3525159535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f575c072910 0x7f575c14d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:35:14.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f575affd640 1 --2- 172.21.15.43:0/3525159535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f575c0cb490 0x7f575c1477d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5750009950 tx=0x7f5750033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:14.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f5743fff640 1 -- 172.21.15.43:0/3525159535 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750005c90 con 0x7f575c0cb490 2024-09-17T04:35:14.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f5743fff640 1 -- 172.21.15.43:0/3525159535 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5750031e50 con 0x7f575c0cb490 2024-09-17T04:35:14.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f576200e640 1 -- 172.21.15.43:0/3525159535 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575c0c87d0 con 0x7f575c0cb490 2024-09-17T04:35:14.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.319+0000 7f5743fff640 1 -- 172.21.15.43:0/3525159535 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57500332f0 con 0x7f575c0cb490 2024-09-17T04:35:14.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.320+0000 7f576200e640 1 -- 172.21.15.43:0/3525159535 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f575c0c7dc0 con 0x7f575c0cb490 2024-09-17T04:35:14.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.321+0000 7f5743fff640 1 -- 172.21.15.43:0/3525159535 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5750033490 con 0x7f575c0cb490 2024-09-17T04:35:14.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.322+0000 7f5743fff640 1 --2- 172.21.15.43:0/3525159535 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5748078b90 0x7f574807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.322+0000 7f5743fff640 1 -- 172.21.15.43:0/3525159535 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f57500bc070 con 0x7f575c0cb490 2024-09-17T04:35:14.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.322+0000 7f575b7fe640 1 --2- 172.21.15.43:0/3525159535 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5748078b90 0x7f574807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.323+0000 7f576905b740 1 Processor -- start 2024-09-17T04:35:14.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.323+0000 7f575b7fe640 1 --2- 172.21.15.43:0/3525159535 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5748078b90 0x7f574807b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f574c005fd0 tx=0x7f574c00f360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:14.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.323+0000 7f576905b740 1 -- start start 2024-09-17T04:35:14.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.324+0000 7f576905b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da996270 0x55a1dad821e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.324+0000 7f576905b740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da96d3b0 0x55a1dad38940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.324+0000 7f576905b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da975590 0x55a1dad3db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.324+0000 7f576905b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a1dacb0820 con 0x55a1da996270 2024-09-17T04:35:14.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.324+0000 7f576905b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a1dac9fc50 con 0x55a1da975590 2024-09-17T04:35:14.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.324+0000 7f576905b740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55a1daca3a60 con 0x55a1da96d3b0 2024-09-17T04:35:14.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.324+0000 7f575b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da996270 0x55a1dad821e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.324+0000 7f575b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da996270 0x55a1dad821e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37146/0 (socket says 172.21.15.43:37146) 2024-09-17T04:35:14.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.324+0000 7f575b7fe640 1 -- 172.21.15.43:0/2692233525 learned_addr learned my addr 172.21.15.43:0/2692233525 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:14.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.325+0000 7f575affd640 1 --2- 172.21.15.43:0/2692233525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da96d3b0 0x55a1dad38940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.325+0000 7f575bfff640 1 --2- 172.21.15.43:0/2692233525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da975590 0x55a1dad3db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.325+0000 7f575b7fe640 1 -- 172.21.15.43:0/2692233525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da96d3b0 msgr2=0x55a1dad38940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.325+0000 7f575b7fe640 1 --2- 172.21.15.43:0/2692233525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da96d3b0 0x55a1dad38940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.325+0000 7f575b7fe640 1 -- 172.21.15.43:0/2692233525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da975590 msgr2=0x55a1dad3db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.325+0000 7f575b7fe640 1 --2- 172.21.15.43:0/2692233525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da975590 0x55a1dad3db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.325+0000 7f575b7fe640 1 -- 172.21.15.43:0/2692233525 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1daa01850 con 0x55a1da996270 2024-09-17T04:35:14.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.325+0000 7f575b7fe640 1 --2- 172.21.15.43:0/2692233525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da996270 0x55a1dad821e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f574c00ff10 tx=0x7f574c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992f5eec05469ce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:14.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.325+0000 7f57417fa640 1 -- 172.21.15.43:0/2692233525 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c022070 con 0x55a1da996270 2024-09-17T04:35:14.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.325+0000 7f57417fa640 1 -- 172.21.15.43:0/2692233525 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f574c011e50 con 0x55a1da996270 2024-09-17T04:35:14.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.325+0000 7f57417fa640 1 -- 172.21.15.43:0/2692233525 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c01e9a0 con 0x55a1da996270 2024-09-17T04:35:14.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.326+0000 7f576905b740 1 -- 172.21.15.43:0/2692233525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da996270 msgr2=0x55a1dad821e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.326+0000 7f576905b740 1 --2- 172.21.15.43:0/2692233525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da996270 0x55a1dad821e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f574c00ff10 tx=0x7f574c012000 comp rx=0 tx=0).stop 2024-09-17T04:35:14.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.326+0000 7f576905b740 1 -- 172.21.15.43:0/2692233525 shutdown_connections 2024-09-17T04:35:14.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.326+0000 7f576905b740 1 --2- 172.21.15.43:0/2692233525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da975590 0x55a1dad3db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.326+0000 7f576905b740 1 --2- 172.21.15.43:0/2692233525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da96d3b0 0x55a1dad38940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.326+0000 7f576905b740 1 --2- 172.21.15.43:0/2692233525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da996270 0x55a1dad821e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.326+0000 7f576905b740 1 -- 172.21.15.43:0/2692233525 >> 172.21.15.43:0/2692233525 conn(0x55a1da98a3c0 msgr2=0x55a1dad81920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:14.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.326+0000 7f576905b740 1 -- 172.21.15.43:0/2692233525 shutdown_connections 2024-09-17T04:35:14.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.326+0000 7f576905b740 1 -- 172.21.15.43:0/2692233525 wait complete. 2024-09-17T04:35:14.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.327+0000 7f576905b740 1 -- start start 2024-09-17T04:35:14.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.327+0000 7f576905b740 1 Processor -- start 2024-09-17T04:35:14.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.328+0000 7f576905b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da96d3b0 0x55a1dad906a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.328+0000 7f576905b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da975590 0x55a1dad6ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.328+0000 7f576905b740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da996270 0x55a1dad372a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.328+0000 7f576905b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a1daa10620 con 0x55a1da975590 2024-09-17T04:35:14.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.328+0000 7f576905b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a1dac455f0 con 0x55a1da96d3b0 2024-09-17T04:35:14.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.328+0000 7f576905b740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55a1dad90df0 con 0x55a1da996270 2024-09-17T04:35:14.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f576905b740 10 client.0 _ll_register_callbacks cb 0x55a1dac490a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T04:35:14.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f575affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da975590 0x55a1dad6ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f575affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da975590 0x55a1dad6ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37156/0 (socket says 172.21.15.43:37156) 2024-09-17T04:35:14.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f575affd640 1 -- 172.21.15.43:0/1081087362 learned_addr learned my addr 172.21.15.43:0/1081087362 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:14.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f575b7fe640 1 --2- 172.21.15.43:0/1081087362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da96d3b0 0x55a1dad906a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f575bfff640 1 --2- 172.21.15.43:0/1081087362 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da996270 0x55a1dad372a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f575affd640 1 -- 172.21.15.43:0/1081087362 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da996270 msgr2=0x55a1dad372a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f575affd640 1 --2- 172.21.15.43:0/1081087362 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da996270 0x55a1dad372a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f575affd640 1 -- 172.21.15.43:0/1081087362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da96d3b0 msgr2=0x55a1dad906a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f575affd640 1 --2- 172.21.15.43:0/1081087362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da96d3b0 0x55a1dad906a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f575affd640 1 -- 172.21.15.43:0/1081087362 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1daa786b0 con 0x55a1da975590 2024-09-17T04:35:14.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f575affd640 1 --2- 172.21.15.43:0/1081087362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da975590 0x55a1dad6ea40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5750009920 tx=0x7f57500843b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee458a5b75ea977e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:14.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f573a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-17T04:35:14.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f573a7fc640 1 -- 172.21.15.43:0/1081087362 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575008d5d0 con 0x55a1da975590 2024-09-17T04:35:14.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f573a7fc640 1 -- 172.21.15.43:0/1081087362 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f575006f180 con 0x55a1da975590 2024-09-17T04:35:14.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f576905b740 1 -- 172.21.15.43:0/1081087362 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f574c011e50 con 0x55a1da975590 2024-09-17T04:35:14.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f573a7fc640 1 -- 172.21.15.43:0/1081087362 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f575009e020 con 0x55a1da975590 2024-09-17T04:35:14.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f576905b740 10 client.4815 fetch_fsmap learned FSMap version 13 2024-09-17T04:35:14.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.329+0000 7f576905b740 1 -- 172.21.15.43:0/1081087362 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55a1dad37f50 con 0x55a1da975590 2024-09-17T04:35:14.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.330+0000 7f573a7fc640 1 -- 172.21.15.43:0/1081087362 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f574c011e50 con 0x55a1da975590 2024-09-17T04:35:14.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.330+0000 7f573a7fc640 1 -- 172.21.15.43:0/1081087362 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 13) ==== 4752+0+0 (secure 0 0 0) 0x7f575004b030 con 0x55a1da975590 2024-09-17T04:35:14.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.330+0000 7f576905b740 10 client.4815 fetch_fsmap finished waiting for FSMap version 13 2024-09-17T04:35:14.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.330+0000 7f576905b740 10 client.4815 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-17T04:35:14.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.330+0000 7f576905b740 20 client.4815 populate_metadata read hostname 'smithi043' 2024-09-17T04:35:14.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.330+0000 7f576905b740 1 --2- 172.21.15.43:0/1081087362 >> [v2:172.21.15.43:6836/3935895854,v1:172.21.15.43:6837/3935895854] conn(0x55a1da954e40 0x55a1dad9bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.330+0000 7f576905b740 4 client.4815 mds_command: new command op to 4437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T04:35:14.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.330+0000 7f576905b740 1 -- 172.21.15.43:0/1081087362 --> [v2:172.21.15.43:6836/3935895854,v1:172.21.15.43:6837/3935895854] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1dacb2770 con 0x55a1da954e40 2024-09-17T04:35:14.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.330+0000 7f575b7fe640 1 --2- 172.21.15.43:0/1081087362 >> [v2:172.21.15.43:6836/3935895854,v1:172.21.15.43:6837/3935895854] conn(0x55a1da954e40 0x55a1dad9bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.330+0000 7f573a7fc640 10 client.4815 ms_handle_connect on v2:172.21.15.43:6836/3935895854 2024-09-17T04:35:14.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.330+0000 7f575b7fe640 1 --2- 172.21.15.43:0/1081087362 >> [v2:172.21.15.43:6836/3935895854,v1:172.21.15.43:6837/3935895854] conn(0x55a1da954e40 0x55a1dad9bd40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1101aeec46ffe8f6 server_cookie=892438d1ad8df946 in_seq=0 out_seq=0 2024-09-17T04:35:14.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.331+0000 7f573a7fc640 1 -- 172.21.15.43:0/1081087362 <== mds.1 v2:172.21.15.43:6836/3935895854 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a1dacb2770 con 0x55a1da954e40 2024-09-17T04:35:14.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.331+0000 7f573a7fc640 10 client.4815 handle_command_reply: tid=0 2024-09-17T04:35:14.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.331+0000 7f576905b740 1 client.4815 shutdown 2024-09-17T04:35:14.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.331+0000 7f576905b740 1 -- 172.21.15.43:0/1081087362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da975590 msgr2=0x55a1dad6ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.331+0000 7f576905b740 1 --2- 172.21.15.43:0/1081087362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da975590 0x55a1dad6ea40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5750009920 tx=0x7f57500843b0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.331+0000 7f576905b740 1 -- 172.21.15.43:0/1081087362 shutdown_connections 2024-09-17T04:35:14.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.331+0000 7f576905b740 1 --2- 172.21.15.43:0/1081087362 >> [v2:172.21.15.43:6836/3935895854,v1:172.21.15.43:6837/3935895854] conn(0x55a1da954e40 0x55a1dad9bd40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.331+0000 7f576905b740 1 --2- 172.21.15.43:0/1081087362 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da996270 0x55a1dad372a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.331+0000 7f573a7fc640 0 client.4815 ms_handle_reset on v2:172.21.15.43:6836/3935895854 2024-09-17T04:35:14.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.331+0000 7f576905b740 1 --2- 172.21.15.43:0/1081087362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da975590 0x55a1dad6ea40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.331+0000 7f576905b740 1 --2- 172.21.15.43:0/1081087362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da96d3b0 0x55a1dad906a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.331+0000 7f576905b740 1 -- 172.21.15.43:0/1081087362 >> 172.21.15.43:0/1081087362 conn(0x55a1da98a3c0 msgr2=0x55a1dad38760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:14.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.331+0000 7f576905b740 1 -- 172.21.15.43:0/1081087362 shutdown_connections 2024-09-17T04:35:14.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.331+0000 7f576905b740 1 -- 172.21.15.43:0/1081087362 wait complete. 2024-09-17T04:35:14.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.332+0000 7f576905b740 20 client.4815 trim_cache size 0 max 16384 2024-09-17T04:35:14.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.351+0000 7f576905b740 1 Processor -- start 2024-09-17T04:35:14.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.351+0000 7f576905b740 1 -- start start 2024-09-17T04:35:14.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.352+0000 7f576905b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da96d3b0 0x55a1dad68900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.352+0000 7f576905b740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da975590 0x55a1dad386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.352+0000 7f576905b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da996270 0x55a1dad38be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.352+0000 7f576905b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f575c1f3b70 con 0x55a1da996270 2024-09-17T04:35:14.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.352+0000 7f576905b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a1dad76a60 con 0x55a1da96d3b0 2024-09-17T04:35:14.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.352+0000 7f576905b740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55a1dad39220 con 0x55a1da975590 2024-09-17T04:35:14.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.352+0000 7f575bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da996270 0x55a1dad38be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.352+0000 7f575bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da996270 0x55a1dad38be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37162/0 (socket says 172.21.15.43:37162) 2024-09-17T04:35:14.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.352+0000 7f575bfff640 1 -- 172.21.15.43:0/2091172068 learned_addr learned my addr 172.21.15.43:0/2091172068 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:14.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.352+0000 7f575affd640 1 --2- 172.21.15.43:0/2091172068 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da975590 0x55a1dad386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.352+0000 7f575b7fe640 1 --2- 172.21.15.43:0/2091172068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da96d3b0 0x55a1dad68900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.352+0000 7f575bfff640 1 -- 172.21.15.43:0/2091172068 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da975590 msgr2=0x55a1dad386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.352+0000 7f575bfff640 1 --2- 172.21.15.43:0/2091172068 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da975590 0x55a1dad386a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.352+0000 7f575bfff640 1 -- 172.21.15.43:0/2091172068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da96d3b0 msgr2=0x55a1dad68900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.352+0000 7f575bfff640 1 --2- 172.21.15.43:0/2091172068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da96d3b0 0x55a1dad68900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.352+0000 7f575bfff640 1 -- 172.21.15.43:0/2091172068 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1dad3a920 con 0x55a1da996270 2024-09-17T04:35:14.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.353+0000 7f575bfff640 1 --2- 172.21.15.43:0/2091172068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da996270 0x55a1dad38be0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5754015550 tx=0x7f5754015a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c44dfcaca6ea4dd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:14.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.353+0000 7f5740ff9640 1 -- 172.21.15.43:0/2091172068 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754016750 con 0x55a1da996270 2024-09-17T04:35:14.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.353+0000 7f5740ff9640 1 -- 172.21.15.43:0/2091172068 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f575401a070 con 0x55a1da996270 2024-09-17T04:35:14.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.353+0000 7f5740ff9640 1 -- 172.21.15.43:0/2091172068 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754016c20 con 0x55a1da996270 2024-09-17T04:35:14.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.354+0000 7f576905b740 1 -- 172.21.15.43:0/2091172068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da996270 msgr2=0x55a1dad38be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.354+0000 7f576905b740 1 --2- 172.21.15.43:0/2091172068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da996270 0x55a1dad38be0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5754015550 tx=0x7f5754015a10 comp rx=0 tx=0).stop 2024-09-17T04:35:14.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.354+0000 7f576905b740 1 -- 172.21.15.43:0/2091172068 shutdown_connections 2024-09-17T04:35:14.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.354+0000 7f576905b740 1 --2- 172.21.15.43:0/2091172068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da996270 0x55a1dad38be0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.354+0000 7f576905b740 1 --2- 172.21.15.43:0/2091172068 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da975590 0x55a1dad386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.354+0000 7f576905b740 1 --2- 172.21.15.43:0/2091172068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da96d3b0 0x55a1dad68900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.354+0000 7f576905b740 1 -- 172.21.15.43:0/2091172068 >> 172.21.15.43:0/2091172068 conn(0x55a1da98a3c0 msgr2=0x55a1dad77e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:14.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.354+0000 7f576905b740 1 -- 172.21.15.43:0/2091172068 shutdown_connections 2024-09-17T04:35:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.354+0000 7f576905b740 1 -- 172.21.15.43:0/2091172068 wait complete. 2024-09-17T04:35:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.355+0000 7f576905b740 1 -- start start 2024-09-17T04:35:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.355+0000 7f576905b740 1 Processor -- start 2024-09-17T04:35:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f576905b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da96d3b0 0x55a1dad6e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f576905b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da975590 0x55a1dadf8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f576905b740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da996270 0x55a1dadf8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f576905b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a1dad730c0 con 0x55a1da975590 2024-09-17T04:35:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f576905b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a1dad6ef80 con 0x55a1da96d3b0 2024-09-17T04:35:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f576905b740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55a1dad74e30 con 0x55a1da996270 2024-09-17T04:35:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f576905b740 10 client.0 _ll_register_callbacks cb 0x7f575007fd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T04:35:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f575affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da975590 0x55a1dadf8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f575affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da975590 0x55a1dadf8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37178/0 (socket says 172.21.15.43:37178) 2024-09-17T04:35:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f575affd640 1 -- 172.21.15.43:0/3640378406 learned_addr learned my addr 172.21.15.43:0/3640378406 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f575b7fe640 1 --2- 172.21.15.43:0/3640378406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da96d3b0 0x55a1dad6e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f575affd640 1 -- 172.21.15.43:0/3640378406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da996270 msgr2=0x55a1dadf8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f575bfff640 1 --2- 172.21.15.43:0/3640378406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da996270 0x55a1dadf8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f575affd640 1 --2- 172.21.15.43:0/3640378406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da996270 0x55a1dadf8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f575affd640 1 -- 172.21.15.43:0/3640378406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da96d3b0 msgr2=0x55a1dad6e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f575affd640 1 --2- 172.21.15.43:0/3640378406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da96d3b0 0x55a1dad6e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f575affd640 1 -- 172.21.15.43:0/3640378406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1dad7e740 con 0x55a1da975590 2024-09-17T04:35:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.356+0000 7f575b7fe640 1 --2- 172.21.15.43:0/3640378406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da96d3b0 0x55a1dad6e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:35:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.357+0000 7f575affd640 1 --2- 172.21.15.43:0/3640378406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da975590 0x55a1dadf8450 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5750031920 tx=0x7f575009e260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942a708e8bdfd837 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.357+0000 7f573a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-17T04:35:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.357+0000 7f573a7fc640 1 -- 172.21.15.43:0/3640378406 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750083820 con 0x55a1da975590 2024-09-17T04:35:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.357+0000 7f573a7fc640 1 -- 172.21.15.43:0/3640378406 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5750089b40 con 0x55a1da975590 2024-09-17T04:35:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.357+0000 7f576905b740 1 -- 172.21.15.43:0/3640378406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f575401a070 con 0x55a1da975590 2024-09-17T04:35:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.357+0000 7f573a7fc640 1 -- 172.21.15.43:0/3640378406 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f57500845d0 con 0x55a1da975590 2024-09-17T04:35:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.357+0000 7f576905b740 10 client.4821 fetch_fsmap learned FSMap version 13 2024-09-17T04:35:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.357+0000 7f576905b740 1 -- 172.21.15.43:0/3640378406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55a1dad7e740 con 0x55a1da975590 2024-09-17T04:35:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.357+0000 7f573a7fc640 1 -- 172.21.15.43:0/3640378406 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f575401a070 con 0x55a1da975590 2024-09-17T04:35:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.357+0000 7f573a7fc640 1 -- 172.21.15.43:0/3640378406 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 13) ==== 4752+0+0 (secure 0 0 0) 0x7f575004b040 con 0x55a1da975590 2024-09-17T04:35:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.357+0000 7f576905b740 10 client.4821 fetch_fsmap finished waiting for FSMap version 13 2024-09-17T04:35:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.357+0000 7f576905b740 10 client.4821 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-17T04:35:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.357+0000 7f576905b740 20 client.4821 populate_metadata read hostname 'smithi043' 2024-09-17T04:35:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.357+0000 7f576905b740 1 --2- 172.21.15.43:0/3640378406 >> [v2:172.21.15.43:6836/3935895854,v1:172.21.15.43:6837/3935895854] conn(0x55a1dad6b620 0x55a1dae0ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.357+0000 7f576905b740 4 client.4821 mds_command: new command op to 4437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T04:35:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.357+0000 7f576905b740 1 -- 172.21.15.43:0/3640378406 --> [v2:172.21.15.43:6836/3935895854,v1:172.21.15.43:6837/3935895854] -- command(tid 0: {"prefix": "status"}) -- 0x55a1dacae220 con 0x55a1dad6b620 2024-09-17T04:35:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.357+0000 7f575b7fe640 1 --2- 172.21.15.43:0/3640378406 >> [v2:172.21.15.43:6836/3935895854,v1:172.21.15.43:6837/3935895854] conn(0x55a1dad6b620 0x55a1dae0ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.358+0000 7f573a7fc640 10 client.4821 ms_handle_connect on v2:172.21.15.43:6836/3935895854 2024-09-17T04:35:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.358+0000 7f575b7fe640 1 --2- 172.21.15.43:0/3640378406 >> [v2:172.21.15.43:6836/3935895854,v1:172.21.15.43:6837/3935895854] conn(0x55a1dad6b620 0x55a1dae0ae70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=418dc28efd8ab42d server_cookie=86daa1d25c039292 in_seq=0 out_seq=0 2024-09-17T04:35:14.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.672+0000 7f573a7fc640 1 -- 172.21.15.43:0/3640378406 <== mds.1 v2:172.21.15.43:6836/3935895854 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55a1dacae220 con 0x55a1dad6b620 2024-09-17T04:35:14.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.672+0000 7f573a7fc640 10 client.4821 handle_command_reply: tid=0 2024-09-17T04:35:14.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.672+0000 7f576905b740 1 client.4821 shutdown 2024-09-17T04:35:14.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.672+0000 7f576905b740 1 -- 172.21.15.43:0/3640378406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da975590 msgr2=0x55a1dadf8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.672+0000 7f576905b740 1 --2- 172.21.15.43:0/3640378406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da975590 0x55a1dadf8450 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5750031920 tx=0x7f575009e260 comp rx=0 tx=0).stop 2024-09-17T04:35:14.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.672+0000 7f576905b740 1 -- 172.21.15.43:0/3640378406 shutdown_connections 2024-09-17T04:35:14.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.672+0000 7f576905b740 1 --2- 172.21.15.43:0/3640378406 >> [v2:172.21.15.43:6836/3935895854,v1:172.21.15.43:6837/3935895854] conn(0x55a1dad6b620 0x55a1dae0ae70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.672+0000 7f576905b740 1 --2- 172.21.15.43:0/3640378406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55a1da996270 0x55a1dadf8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.672+0000 7f576905b740 1 --2- 172.21.15.43:0/3640378406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1da975590 0x55a1dadf8450 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.672+0000 7f573a7fc640 0 client.4821 ms_handle_reset on v2:172.21.15.43:6836/3935895854 2024-09-17T04:35:14.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.672+0000 7f576905b740 1 --2- 172.21.15.43:0/3640378406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a1da96d3b0 0x55a1dad6e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.672+0000 7f576905b740 1 -- 172.21.15.43:0/3640378406 >> 172.21.15.43:0/3640378406 conn(0x55a1da98a3c0 msgr2=0x55a1dad7bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:14.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.672+0000 7f576905b740 1 -- 172.21.15.43:0/3640378406 shutdown_connections 2024-09-17T04:35:14.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.672+0000 7f576905b740 1 -- 172.21.15.43:0/3640378406 wait complete. 2024-09-17T04:35:14.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.672+0000 7f576905b740 20 client.4821 trim_cache size 0 max 16384 2024-09-17T04:35:14.674 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-17T04:35:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "cdef1e3e-07e6-43e6-b635-3ed1bc15d64a", 2024-09-17T04:35:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 1, 2024-09-17T04:35:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4437, 2024-09-17T04:35:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-09-17T04:35:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-09-17T04:35:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-09-17T04:35:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 16.567545905999999, 2024-09-17T04:35:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 13, 2024-09-17T04:35:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 22, 2024-09-17T04:35:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 22, 2024-09-17T04:35:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 28.643557498 2024-09-17T04:35:14.674 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-17T04:35:14.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.673+0000 7f576200e640 1 -- 172.21.15.43:0/3525159535 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5748078b90 msgr2=0x7f574807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.673+0000 7f576200e640 1 --2- 172.21.15.43:0/3525159535 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5748078b90 0x7f574807b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f574c005fd0 tx=0x7f574c00f360 comp rx=0 tx=0).stop 2024-09-17T04:35:14.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.673+0000 7f576200e640 1 -- 172.21.15.43:0/3525159535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f575c0cb490 msgr2=0x7f575c1477d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.673+0000 7f576200e640 1 --2- 172.21.15.43:0/3525159535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f575c0cb490 0x7f575c1477d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5750009950 tx=0x7f5750033c90 comp rx=0 tx=0).stop 2024-09-17T04:35:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.673+0000 7f576200e640 1 -- 172.21.15.43:0/3525159535 shutdown_connections 2024-09-17T04:35:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.673+0000 7f576200e640 1 --2- 172.21.15.43:0/3525159535 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5748078b90 0x7f574807b0a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.673+0000 7f576200e640 1 --2- 172.21.15.43:0/3525159535 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f575c1538e0 0x7f575c147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.673+0000 7f576200e640 1 --2- 172.21.15.43:0/3525159535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f575c0cb490 0x7f575c1477d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.673+0000 7f576200e640 1 --2- 172.21.15.43:0/3525159535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f575c072910 0x7f575c14d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.673+0000 7f576200e640 1 -- 172.21.15.43:0/3525159535 >> 172.21.15.43:0/3525159535 conn(0x7f575c0cefa0 msgr2=0x7f575c149b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.673+0000 7f576200e640 1 -- 172.21.15.43:0/3525159535 shutdown_connections 2024-09-17T04:35:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.673+0000 7f576200e640 1 -- 172.21.15.43:0/3525159535 wait complete. 2024-09-17T04:35:14.685 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-09-17T04:35:14.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.804+0000 7f63e605c640 1 -- 172.21.15.43:0/1179003767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63e00c9180 msgr2=0x7f63e0155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.804+0000 7f63e605c640 1 --2- 172.21.15.43:0/1179003767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63e00c9180 0x7f63e0155a20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f63d0005fd0 tx=0x7f63d002a670 comp rx=0 tx=0).stop 2024-09-17T04:35:14.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.804+0000 7f63e605c640 1 -- 172.21.15.43:0/1179003767 shutdown_connections 2024-09-17T04:35:14.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.804+0000 7f63e605c640 1 --2- 172.21.15.43:0/1179003767 >> v2:172.21.15.62:3300/0 conn(0x7f63e00c39d0 0x7f63e0073150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.804+0000 7f63e605c640 1 --2- 172.21.15.43:0/1179003767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63e00c9180 0x7f63e0155a20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.804+0000 7f63e605c640 1 -- 172.21.15.43:0/1179003767 >> 172.21.15.43:0/1179003767 conn(0x7f63e0070540 msgr2=0x7f63e0070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:14.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.804+0000 7f63e605c640 1 -- 172.21.15.43:0/1179003767 shutdown_connections 2024-09-17T04:35:14.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.804+0000 7f63e605c640 1 -- 172.21.15.43:0/1179003767 wait complete. 2024-09-17T04:35:14.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.806+0000 7f63e605c640 1 Processor -- start 2024-09-17T04:35:14.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.806+0000 7f63e605c640 1 -- start start 2024-09-17T04:35:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.807+0000 7f63e605c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63e00c39d0 0x7f63e01f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.807+0000 7f63e605c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63e00c9180 0x7f63e014d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.807+0000 7f63e605c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63e00c99e0 0x7f63e0154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.807+0000 7f63e605c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f63e0155f60 con 0x7f63e00c39d0 2024-09-17T04:35:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.807+0000 7f63e605c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f63e00c1fe0 con 0x7f63e00c99e0 2024-09-17T04:35:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.807+0000 7f63e605c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f63e0073690 con 0x7f63e00c9180 2024-09-17T04:35:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.807+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63e00c39d0 0x7f63e01f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.807+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63e00c39d0 0x7f63e01f5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37190/0 (socket says 172.21.15.43:37190) 2024-09-17T04:35:14.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.807+0000 7f63df7fe640 1 -- 172.21.15.43:0/2027129289 learned_addr learned my addr 172.21.15.43:0/2027129289 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:14.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.807+0000 7f63d6ffd640 1 --2- 172.21.15.43:0/2027129289 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63e00c9180 0x7f63e014d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.807+0000 7f63dffff640 1 --2- 172.21.15.43:0/2027129289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63e00c99e0 0x7f63e0154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.808+0000 7f63df7fe640 1 -- 172.21.15.43:0/2027129289 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63e00c9180 msgr2=0x7f63e014d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.808+0000 7f63df7fe640 1 --2- 172.21.15.43:0/2027129289 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63e00c9180 0x7f63e014d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.808+0000 7f63df7fe640 1 -- 172.21.15.43:0/2027129289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63e00c99e0 msgr2=0x7f63e0154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.808+0000 7f63df7fe640 1 --2- 172.21.15.43:0/2027129289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63e00c99e0 0x7f63e0154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.808+0000 7f63df7fe640 1 -- 172.21.15.43:0/2027129289 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e01f5b40 con 0x7f63e00c39d0 2024-09-17T04:35:14.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.808+0000 7f63df7fe640 1 --2- 172.21.15.43:0/2027129289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63e00c39d0 0x7f63e01f5600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f63d00099f0 tx=0x7f63d00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:14.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.808+0000 7f63dcff9640 1 -- 172.21.15.43:0/2027129289 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d003e030 con 0x7f63e00c39d0 2024-09-17T04:35:14.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.808+0000 7f63dcff9640 1 -- 172.21.15.43:0/2027129289 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63d0003db0 con 0x7f63e00c39d0 2024-09-17T04:35:14.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.808+0000 7f63e605c640 1 -- 172.21.15.43:0/2027129289 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e00b0bd0 con 0x7f63e00c39d0 2024-09-17T04:35:14.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.808+0000 7f63dcff9640 1 -- 172.21.15.43:0/2027129289 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d0035040 con 0x7f63e00c39d0 2024-09-17T04:35:14.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.808+0000 7f63e605c640 1 -- 172.21.15.43:0/2027129289 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e00c5aa0 con 0x7f63e00c39d0 2024-09-17T04:35:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.811+0000 7f63dcff9640 1 -- 172.21.15.43:0/2027129289 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f63d0041030 con 0x7f63e00c39d0 2024-09-17T04:35:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.811+0000 7f63dcff9640 1 --2- 172.21.15.43:0/2027129289 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f63c0078b90 0x7f63c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.811+0000 7f63dcff9640 1 -- 172.21.15.43:0/2027129289 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f63d00bb260 con 0x7f63e00c39d0 2024-09-17T04:35:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.811+0000 7f63d6ffd640 1 --2- 172.21.15.43:0/2027129289 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f63c0078b90 0x7f63c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.812+0000 7f63ecfcd740 1 Processor -- start 2024-09-17T04:35:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.812+0000 7f63d6ffd640 1 --2- 172.21.15.43:0/2027129289 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f63c0078b90 0x7f63c007b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f63e00c5590 tx=0x7f63c8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.812+0000 7f63ecfcd740 1 -- start start 2024-09-17T04:35:14.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.813+0000 7f63ecfcd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76ea270 0x5635d7ad61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.813+0000 7f63ecfcd740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76c13b0 0x5635d7a8c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.813+0000 7f63ecfcd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c9590 0x5635d7a91b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.813+0000 7f63ecfcd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5635d7a04820 con 0x5635d76c9590 2024-09-17T04:35:14.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.813+0000 7f63ecfcd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5635d79f3c50 con 0x5635d76ea270 2024-09-17T04:35:14.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.813+0000 7f63ecfcd740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x5635d79f7a60 con 0x5635d76c13b0 2024-09-17T04:35:14.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.814+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76ea270 0x5635d7ad61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.814+0000 7f63dffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c9590 0x5635d7a91b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.814+0000 7f63d6ffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76c13b0 0x5635d7a8c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.814+0000 7f63dffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c9590 0x5635d7a91b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37206/0 (socket says 172.21.15.43:37206) 2024-09-17T04:35:14.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.814+0000 7f63d6ffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76c13b0 0x5635d7a8c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:34014/0 (socket says 172.21.15.43:34014) 2024-09-17T04:35:14.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.814+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76ea270 0x5635d7ad61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:51786/0 (socket says 172.21.15.43:51786) 2024-09-17T04:35:14.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.814+0000 7f63dffff640 1 -- 172.21.15.43:0/3787413071 learned_addr learned my addr 172.21.15.43:0/3787413071 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:14.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.814+0000 7f63dffff640 1 -- 172.21.15.43:0/3787413071 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76c13b0 msgr2=0x5635d7a8c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.814+0000 7f63dffff640 1 --2- 172.21.15.43:0/3787413071 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76c13b0 0x5635d7a8c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.814+0000 7f63dffff640 1 -- 172.21.15.43:0/3787413071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76ea270 msgr2=0x5635d7ad61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.814+0000 7f63dffff640 1 --2- 172.21.15.43:0/3787413071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76ea270 0x5635d7ad61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.814+0000 7f63dffff640 1 -- 172.21.15.43:0/3787413071 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635d7755850 con 0x5635d76c9590 2024-09-17T04:35:14.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.814+0000 7f63dffff640 1 --2- 172.21.15.43:0/3787413071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c9590 0x5635d7a91b50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f63d8001de0 tx=0x7f63d80015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7032f25380bc81f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:14.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.814+0000 7f63d57fa640 1 -- 172.21.15.43:0/3787413071 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d800fc40 con 0x5635d76c9590 2024-09-17T04:35:14.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.814+0000 7f63d57fa640 1 -- 172.21.15.43:0/3787413071 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63d8018070 con 0x5635d76c9590 2024-09-17T04:35:14.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.814+0000 7f63d57fa640 1 -- 172.21.15.43:0/3787413071 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d8003bd0 con 0x5635d76c9590 2024-09-17T04:35:14.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.815+0000 7f63ecfcd740 1 -- 172.21.15.43:0/3787413071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c9590 msgr2=0x5635d7a91b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.815+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/3787413071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c9590 0x5635d7a91b50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f63d8001de0 tx=0x7f63d80015b0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.815+0000 7f63ecfcd740 1 -- 172.21.15.43:0/3787413071 shutdown_connections 2024-09-17T04:35:14.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.815+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/3787413071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c9590 0x5635d7a91b50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.815+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/3787413071 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76c13b0 0x5635d7a8c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.815+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/3787413071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76ea270 0x5635d7ad61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.815+0000 7f63ecfcd740 1 -- 172.21.15.43:0/3787413071 >> 172.21.15.43:0/3787413071 conn(0x5635d76de3c0 msgr2=0x5635d7ad5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:14.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.815+0000 7f63ecfcd740 1 -- 172.21.15.43:0/3787413071 shutdown_connections 2024-09-17T04:35:14.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.815+0000 7f63ecfcd740 1 -- 172.21.15.43:0/3787413071 wait complete. 2024-09-17T04:35:14.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.816+0000 7f63ecfcd740 1 -- start start 2024-09-17T04:35:14.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.816+0000 7f63ecfcd740 1 Processor -- start 2024-09-17T04:35:14.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63ecfcd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c13b0 0x5635d7ad0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63ecfcd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76c9590 0x5635d7acb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63ecfcd740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76ea270 0x5635d7ac2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63ecfcd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5635d7764620 con 0x5635d76c13b0 2024-09-17T04:35:14.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63ecfcd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5635d79995f0 con 0x5635d76c9590 2024-09-17T04:35:14.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63ecfcd740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x5635d7ac99a0 con 0x5635d76ea270 2024-09-17T04:35:14.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63ecfcd740 10 client.0 _ll_register_callbacks cb 0x5635d799d0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T04:35:14.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c13b0 0x5635d7ad0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c13b0 0x5635d7ad0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37210/0 (socket says 172.21.15.43:37210) 2024-09-17T04:35:14.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63df7fe640 1 -- 172.21.15.43:0/1570608102 learned_addr learned my addr 172.21.15.43:0/1570608102 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:14.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63dffff640 1 --2- 172.21.15.43:0/1570608102 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76ea270 0x5635d7ac2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63d6ffd640 1 --2- 172.21.15.43:0/1570608102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76c9590 0x5635d7acb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63df7fe640 1 -- 172.21.15.43:0/1570608102 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76ea270 msgr2=0x5635d7ac2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63df7fe640 1 --2- 172.21.15.43:0/1570608102 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76ea270 0x5635d7ac2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63df7fe640 1 -- 172.21.15.43:0/1570608102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76c9590 msgr2=0x5635d7acb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63df7fe640 1 --2- 172.21.15.43:0/1570608102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76c9590 0x5635d7acb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63df7fe640 1 -- 172.21.15.43:0/1570608102 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635d77cc6b0 con 0x5635d76c13b0 2024-09-17T04:35:14.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63df7fe640 1 --2- 172.21.15.43:0/1570608102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c13b0 0x5635d7ad0b80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f63d00b97c0 tx=0x7f63d007f080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587b0fe70cb72f21 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:14.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-17T04:35:14.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63be7fc640 1 -- 172.21.15.43:0/1570608102 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d0048040 con 0x5635d76c13b0 2024-09-17T04:35:14.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63be7fc640 1 -- 172.21.15.43:0/1570608102 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f63d008c7c0 con 0x5635d76c13b0 2024-09-17T04:35:14.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.818+0000 7f63ecfcd740 1 -- 172.21.15.43:0/1570608102 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63d8018070 con 0x5635d76c13b0 2024-09-17T04:35:14.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.819+0000 7f63be7fc640 1 -- 172.21.15.43:0/1570608102 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f63d00828e0 con 0x5635d76c13b0 2024-09-17T04:35:14.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.819+0000 7f63ecfcd740 10 client.4830 fetch_fsmap learned FSMap version 13 2024-09-17T04:35:14.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.819+0000 7f63ecfcd740 1 -- 172.21.15.43:0/1570608102 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x5635d7acbcf0 con 0x5635d76c13b0 2024-09-17T04:35:14.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.819+0000 7f63be7fc640 1 -- 172.21.15.43:0/1570608102 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63d8018070 con 0x5635d76c13b0 2024-09-17T04:35:14.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.819+0000 7f63be7fc640 1 -- 172.21.15.43:0/1570608102 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 13) ==== 4752+0+0 (secure 0 0 0) 0x7f63d00b9bb0 con 0x5635d76c13b0 2024-09-17T04:35:14.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.819+0000 7f63ecfcd740 10 client.4830 fetch_fsmap finished waiting for FSMap version 13 2024-09-17T04:35:14.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.819+0000 7f63ecfcd740 10 client.4830 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-17T04:35:14.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.819+0000 7f63ecfcd740 20 client.4830 populate_metadata read hostname 'smithi043' 2024-09-17T04:35:14.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.819+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/1570608102 >> [v2:172.21.15.62:6838/3263944095,v1:172.21.15.62:6839/3263944095] conn(0x5635d76a8e40 0x5635d7aefe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.819+0000 7f63ecfcd740 4 client.4830 mds_command: new command op to 4455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T04:35:14.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.819+0000 7f63ecfcd740 1 -- 172.21.15.43:0/1570608102 --> [v2:172.21.15.62:6838/3263944095,v1:172.21.15.62:6839/3263944095] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635d7a06770 con 0x5635d76a8e40 2024-09-17T04:35:14.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.819+0000 7f63d6ffd640 1 --2- 172.21.15.43:0/1570608102 >> [v2:172.21.15.62:6838/3263944095,v1:172.21.15.62:6839/3263944095] conn(0x5635d76a8e40 0x5635d7aefe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.820+0000 7f63be7fc640 10 client.4830 ms_handle_connect on v2:172.21.15.62:6838/3263944095 2024-09-17T04:35:14.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.820+0000 7f63d6ffd640 1 --2- 172.21.15.43:0/1570608102 >> [v2:172.21.15.62:6838/3263944095,v1:172.21.15.62:6839/3263944095] conn(0x5635d76a8e40 0x5635d7aefe40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be0ecd8c83792041 server_cookie=f352e303c02476e2 in_seq=0 out_seq=0 2024-09-17T04:35:14.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.820+0000 7f63be7fc640 1 -- 172.21.15.43:0/1570608102 <== mds.0 v2:172.21.15.62:6838/3263944095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5635d7a06770 con 0x5635d76a8e40 2024-09-17T04:35:14.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.820+0000 7f63be7fc640 10 client.4830 handle_command_reply: tid=0 2024-09-17T04:35:14.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.820+0000 7f63ecfcd740 1 client.4830 shutdown 2024-09-17T04:35:14.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.821+0000 7f63ecfcd740 1 -- 172.21.15.43:0/1570608102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c13b0 msgr2=0x5635d7ad0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.821+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/1570608102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c13b0 0x5635d7ad0b80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f63d00b97c0 tx=0x7f63d007f080 comp rx=0 tx=0).stop 2024-09-17T04:35:14.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.821+0000 7f63ecfcd740 1 -- 172.21.15.43:0/1570608102 shutdown_connections 2024-09-17T04:35:14.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.821+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/1570608102 >> [v2:172.21.15.62:6838/3263944095,v1:172.21.15.62:6839/3263944095] conn(0x5635d76a8e40 0x5635d7aefe40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.821+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/1570608102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76c9590 0x5635d7acb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.821+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/1570608102 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76ea270 0x5635d7ac2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.821+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/1570608102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c13b0 0x5635d7ad0b80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.821+0000 7f63be7fc640 0 client.4830 ms_handle_reset on v2:172.21.15.62:6838/3263944095 2024-09-17T04:35:14.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.821+0000 7f63ecfcd740 1 -- 172.21.15.43:0/1570608102 >> 172.21.15.43:0/1570608102 conn(0x5635d76de3c0 msgr2=0x5635d7a8c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:14.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.821+0000 7f63ecfcd740 1 -- 172.21.15.43:0/1570608102 shutdown_connections 2024-09-17T04:35:14.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.821+0000 7f63ecfcd740 1 -- 172.21.15.43:0/1570608102 wait complete. 2024-09-17T04:35:14.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.821+0000 7f63ecfcd740 20 client.4830 trim_cache size 0 max 16384 2024-09-17T04:35:14.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.839+0000 7f63ecfcd740 1 Processor -- start 2024-09-17T04:35:14.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.839+0000 7f63ecfcd740 1 -- start start 2024-09-17T04:35:14.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63ecfcd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76a8e40 0x5635d7a8db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63ecfcd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c13b0 0x5635d7ac9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63ecfcd740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76c9590 0x5635d7aca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63ecfcd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f63e01442a0 con 0x5635d76c13b0 2024-09-17T04:35:14.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63ecfcd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5635d7acf410 con 0x5635d76a8e40 2024-09-17T04:35:14.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63ecfcd740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x5635d7ac2f80 con 0x5635d76c9590 2024-09-17T04:35:14.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63d6ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c13b0 0x5635d7ac9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63d6ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c13b0 0x5635d7ac9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37220/0 (socket says 172.21.15.43:37220) 2024-09-17T04:35:14.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63d6ffd640 1 -- 172.21.15.43:0/1475372056 learned_addr learned my addr 172.21.15.43:0/1475372056 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:14.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63d6ffd640 1 -- 172.21.15.43:0/1475372056 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76c9590 msgr2=0x5635d7aca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63df7fe640 1 --2- 172.21.15.43:0/1475372056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76a8e40 0x5635d7a8db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63dffff640 1 --2- 172.21.15.43:0/1475372056 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76c9590 0x5635d7aca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63d6ffd640 1 --2- 172.21.15.43:0/1475372056 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76c9590 0x5635d7aca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63d6ffd640 1 -- 172.21.15.43:0/1475372056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76a8e40 msgr2=0x5635d7a8db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63d6ffd640 1 --2- 172.21.15.43:0/1475372056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76a8e40 0x5635d7a8db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63d6ffd640 1 -- 172.21.15.43:0/1475372056 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635d7ac2d10 con 0x5635d76c13b0 2024-09-17T04:35:14.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63df7fe640 1 --2- 172.21.15.43:0/1475372056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76a8e40 0x5635d7a8db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:35:14.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63dffff640 1 --2- 172.21.15.43:0/1475372056 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76c9590 0x5635d7aca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:35:14.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63d6ffd640 1 --2- 172.21.15.43:0/1475372056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c13b0 0x5635d7ac9f90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f63e0071f80 tx=0x7f63c8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632914eaaf97433 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:14.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63d4ff9640 1 -- 172.21.15.43:0/1475372056 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c8003d70 con 0x5635d76c13b0 2024-09-17T04:35:14.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63d4ff9640 1 -- 172.21.15.43:0/1475372056 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63c8005020 con 0x5635d76c13b0 2024-09-17T04:35:14.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.841+0000 7f63d4ff9640 1 -- 172.21.15.43:0/1475372056 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c8005430 con 0x5635d76c13b0 2024-09-17T04:35:14.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.842+0000 7f63ecfcd740 1 -- 172.21.15.43:0/1475372056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c13b0 msgr2=0x5635d7ac9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.842+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/1475372056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c13b0 0x5635d7ac9f90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f63e0071f80 tx=0x7f63c8014000 comp rx=0 tx=0).stop 2024-09-17T04:35:14.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.842+0000 7f63ecfcd740 1 -- 172.21.15.43:0/1475372056 shutdown_connections 2024-09-17T04:35:14.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.842+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/1475372056 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76c9590 0x5635d7aca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.842+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/1475372056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76c13b0 0x5635d7ac9f90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.842+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/1475372056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76a8e40 0x5635d7a8db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.842+0000 7f63ecfcd740 1 -- 172.21.15.43:0/1475372056 >> 172.21.15.43:0/1475372056 conn(0x5635d76de3c0 msgr2=0x5635d7ac2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:14.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.842+0000 7f63ecfcd740 1 -- 172.21.15.43:0/1475372056 shutdown_connections 2024-09-17T04:35:14.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.842+0000 7f63ecfcd740 1 -- 172.21.15.43:0/1475372056 wait complete. 2024-09-17T04:35:14.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.843+0000 7f63ecfcd740 1 -- start start 2024-09-17T04:35:14.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.843+0000 7f63ecfcd740 1 Processor -- start 2024-09-17T04:35:14.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63ecfcd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76a8e40 0x5635d7abb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63ecfcd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76c13b0 0x5635d7a90a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63ecfcd740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76c9590 0x5635d7b4c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63ecfcd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5635d7ac92d0 con 0x5635d76a8e40 2024-09-17T04:35:14.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63ecfcd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5635d7ac6f10 con 0x5635d76c13b0 2024-09-17T04:35:14.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63ecfcd740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x5635d7a8b570 con 0x5635d76c9590 2024-09-17T04:35:14.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76a8e40 0x5635d7abb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63ecfcd740 10 client.0 _ll_register_callbacks cb 0x7f63d0009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T04:35:14.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76a8e40 0x5635d7abb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37228/0 (socket says 172.21.15.43:37228) 2024-09-17T04:35:14.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63df7fe640 1 -- 172.21.15.43:0/853300000 learned_addr learned my addr 172.21.15.43:0/853300000 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:14.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63dffff640 1 --2- 172.21.15.43:0/853300000 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76c9590 0x5635d7b4c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63d6ffd640 1 --2- 172.21.15.43:0/853300000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76c13b0 0x5635d7a90a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63df7fe640 1 -- 172.21.15.43:0/853300000 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76c9590 msgr2=0x5635d7b4c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63df7fe640 1 --2- 172.21.15.43:0/853300000 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76c9590 0x5635d7b4c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63df7fe640 1 -- 172.21.15.43:0/853300000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76c13b0 msgr2=0x5635d7a90a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:35:14.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63df7fe640 1 --2- 172.21.15.43:0/853300000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76c13b0 0x5635d7a90a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63df7fe640 1 -- 172.21.15.43:0/853300000 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635d7ac67d0 con 0x5635d76a8e40 2024-09-17T04:35:14.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63df7fe640 1 --2- 172.21.15.43:0/853300000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76a8e40 0x5635d7abb3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f63d0005f70 tx=0x7f63d009d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a868082fea48bba server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:14.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-17T04:35:14.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63be7fc640 1 -- 172.21.15.43:0/853300000 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d0048070 con 0x5635d76a8e40 2024-09-17T04:35:14.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63be7fc640 1 -- 172.21.15.43:0/853300000 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f63d00b9bb0 con 0x5635d76a8e40 2024-09-17T04:35:14.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63ecfcd740 1 -- 172.21.15.43:0/853300000 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63c8005020 con 0x5635d76a8e40 2024-09-17T04:35:14.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.845+0000 7f63be7fc640 1 -- 172.21.15.43:0/853300000 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f63d007f7c0 con 0x5635d76a8e40 2024-09-17T04:35:14.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.846+0000 7f63ecfcd740 10 client.4836 fetch_fsmap learned FSMap version 13 2024-09-17T04:35:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.846+0000 7f63ecfcd740 1 -- 172.21.15.43:0/853300000 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x5635d7a91680 con 0x5635d76a8e40 2024-09-17T04:35:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.846+0000 7f63be7fc640 1 -- 172.21.15.43:0/853300000 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63c8005020 con 0x5635d76a8e40 2024-09-17T04:35:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.846+0000 7f63be7fc640 1 -- 172.21.15.43:0/853300000 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 13) ==== 4752+0+0 (secure 0 0 0) 0x7f63d00a53b0 con 0x5635d76a8e40 2024-09-17T04:35:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.846+0000 7f63ecfcd740 10 client.4836 fetch_fsmap finished waiting for FSMap version 13 2024-09-17T04:35:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.846+0000 7f63ecfcd740 10 client.4836 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-17T04:35:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.846+0000 7f63ecfcd740 20 client.4836 populate_metadata read hostname 'smithi043' 2024-09-17T04:35:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.846+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/853300000 >> [v2:172.21.15.62:6838/3263944095,v1:172.21.15.62:6839/3263944095] conn(0x5635d767e280 0x5635d7abf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.846+0000 7f63ecfcd740 4 client.4836 mds_command: new command op to 4455 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T04:35:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.846+0000 7f63ecfcd740 1 -- 172.21.15.43:0/853300000 --> [v2:172.21.15.62:6838/3263944095,v1:172.21.15.62:6839/3263944095] -- command(tid 0: {"prefix": "status"}) -- 0x5635d7a02220 con 0x5635d767e280 2024-09-17T04:35:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.846+0000 7f63d6ffd640 1 --2- 172.21.15.43:0/853300000 >> [v2:172.21.15.62:6838/3263944095,v1:172.21.15.62:6839/3263944095] conn(0x5635d767e280 0x5635d7abf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.846+0000 7f63be7fc640 10 client.4836 ms_handle_connect on v2:172.21.15.62:6838/3263944095 2024-09-17T04:35:14.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.846+0000 7f63d6ffd640 1 --2- 172.21.15.43:0/853300000 >> [v2:172.21.15.62:6838/3263944095,v1:172.21.15.62:6839/3263944095] conn(0x5635d767e280 0x5635d7abf620 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bce1e4d43167b1dd server_cookie=8572a8663f5333e9 in_seq=0 out_seq=0 2024-09-17T04:35:14.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.847+0000 7f63be7fc640 1 -- 172.21.15.43:0/853300000 <== mds.0 v2:172.21.15.62:6838/3263944095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5635d7a02220 con 0x5635d767e280 2024-09-17T04:35:14.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.847+0000 7f63be7fc640 10 client.4836 handle_command_reply: tid=0 2024-09-17T04:35:14.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.847+0000 7f63ecfcd740 1 client.4836 shutdown 2024-09-17T04:35:14.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.847+0000 7f63ecfcd740 1 -- 172.21.15.43:0/853300000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76a8e40 msgr2=0x5635d7abb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.847+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/853300000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76a8e40 0x5635d7abb3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f63d0005f70 tx=0x7f63d009d420 comp rx=0 tx=0).stop 2024-09-17T04:35:14.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.847+0000 7f63ecfcd740 1 -- 172.21.15.43:0/853300000 shutdown_connections 2024-09-17T04:35:14.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.847+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/853300000 >> [v2:172.21.15.62:6838/3263944095,v1:172.21.15.62:6839/3263944095] conn(0x5635d767e280 0x5635d7abf620 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.847+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/853300000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5635d76c13b0 0x5635d7a90a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.847+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/853300000 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5635d76c9590 0x5635d7b4c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.847+0000 7f63ecfcd740 1 --2- 172.21.15.43:0/853300000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635d76a8e40 0x5635d7abb3c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.847+0000 7f63be7fc640 0 client.4836 ms_handle_reset on v2:172.21.15.62:6838/3263944095 2024-09-17T04:35:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.847+0000 7f63ecfcd740 1 -- 172.21.15.43:0/853300000 >> 172.21.15.43:0/853300000 conn(0x5635d76de3c0 msgr2=0x5635d7ac23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.847+0000 7f63ecfcd740 1 -- 172.21.15.43:0/853300000 shutdown_connections 2024-09-17T04:35:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.847+0000 7f63ecfcd740 1 -- 172.21.15.43:0/853300000 wait complete. 2024-09-17T04:35:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.847+0000 7f63ecfcd740 20 client.4836 trim_cache size 0 max 16384 2024-09-17T04:35:14.856 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-17T04:35:14.856 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "cdef1e3e-07e6-43e6-b635-3ed1bc15d64a", 2024-09-17T04:35:14.856 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-09-17T04:35:14.857 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4455, 2024-09-17T04:35:14.857 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-09-17T04:35:14.857 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-09-17T04:35:14.857 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-09-17T04:35:14.857 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 22.793123210000001, 2024-09-17T04:35:14.857 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 13, 2024-09-17T04:35:14.857 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 22, 2024-09-17T04:35:14.857 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 22, 2024-09-17T04:35:14.857 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 28.800862038999998 2024-09-17T04:35:14.857 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-17T04:35:14.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.848+0000 7f63e605c640 1 -- 172.21.15.43:0/2027129289 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f63c0078b90 msgr2=0x7f63c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.848+0000 7f63e605c640 1 --2- 172.21.15.43:0/2027129289 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f63c0078b90 0x7f63c007b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f63e00c5590 tx=0x7f63c8005f90 comp rx=0 tx=0).stop 2024-09-17T04:35:14.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.848+0000 7f63e605c640 1 -- 172.21.15.43:0/2027129289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63e00c39d0 msgr2=0x7f63e01f5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:14.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.848+0000 7f63e605c640 1 --2- 172.21.15.43:0/2027129289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63e00c39d0 0x7f63e01f5600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f63d00099f0 tx=0x7f63d00038a0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.848+0000 7f63e605c640 1 -- 172.21.15.43:0/2027129289 shutdown_connections 2024-09-17T04:35:14.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.848+0000 7f63e605c640 1 --2- 172.21.15.43:0/2027129289 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f63c0078b90 0x7f63c007b0a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.848+0000 7f63e605c640 1 --2- 172.21.15.43:0/2027129289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63e00c99e0 0x7f63e0154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.848+0000 7f63e605c640 1 --2- 172.21.15.43:0/2027129289 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63e00c9180 0x7f63e014d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.848+0000 7f63e605c640 1 --2- 172.21.15.43:0/2027129289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63e00c39d0 0x7f63e01f5600 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:14.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.848+0000 7f63e605c640 1 -- 172.21.15.43:0/2027129289 >> 172.21.15.43:0/2027129289 conn(0x7f63e0070540 msgr2=0x7f63e014c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:14.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.848+0000 7f63e605c640 1 -- 172.21.15.43:0/2027129289 shutdown_connections 2024-09-17T04:35:14.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:14.848+0000 7f63e605c640 1 -- 172.21.15.43:0/2027129289 wait complete. 2024-09-17T04:35:14.860 INFO:teuthology.run_tasks:Running task kclient... 2024-09-17T04:35:14.886 INFO:tasks.kclient:Mounting kernel clients... 2024-09-17T04:35:14.887 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-17T04:35:14.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:35:14.887 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-09-17T04:35:14.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:35:14.904 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-09-17T04:35:14.972 INFO:teuthology.orchestra.run.smithi043.stderr:Cannot find device "ceph-brx" 2024-09-17T04:35:14.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:35:14.976 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-17T04:35:14.976 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T04:35:14.976 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T04:35:14.976 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T04:35:15.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.131+0000 7f933a990640 1 -- 172.21.15.43:0/2771548239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93340cc4c0 msgr2=0x7f933415f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:15.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.131+0000 7f933a990640 1 --2- 172.21.15.43:0/2771548239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93340cc4c0 0x7f933415f990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f933408e2c0 tx=0x7f932402a5d0 comp rx=0 tx=0).stop 2024-09-17T04:35:15.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.131+0000 7f933a990640 1 -- 172.21.15.43:0/2771548239 shutdown_connections 2024-09-17T04:35:15.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.131+0000 7f933a990640 1 --2- 172.21.15.43:0/2771548239 >> v2:172.21.15.62:3300/0 conn(0x7f93340ce230 0x7f93340cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:15.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.131+0000 7f933a990640 1 --2- 172.21.15.43:0/2771548239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93340cc4c0 0x7f933415f990 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:15.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.131+0000 7f933a990640 1 -- 172.21.15.43:0/2771548239 >> 172.21.15.43:0/2771548239 conn(0x7f933406f4e0 msgr2=0x7f933406f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:15.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.131+0000 7f933a990640 1 -- 172.21.15.43:0/2771548239 shutdown_connections 2024-09-17T04:35:15.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.131+0000 7f933a990640 1 -- 172.21.15.43:0/2771548239 wait complete. 2024-09-17T04:35:15.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.133+0000 7f933a990640 1 Processor -- start 2024-09-17T04:35:15.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.133+0000 7f933a990640 1 -- start start 2024-09-17T04:35:15.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.134+0000 7f933a990640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93340cc4c0 0x7f93340c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:15.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.134+0000 7f933a990640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93340ce230 0x7f933414b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:15.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.134+0000 7f933a990640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93340ce640 0x7f93340cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:15.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.134+0000 7f933a990640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f933415b990 con 0x7f93340cc4c0 2024-09-17T04:35:15.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.134+0000 7f933a990640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f933415c2a0 con 0x7f93340ce640 2024-09-17T04:35:15.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.134+0000 7f933a990640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f93340ccbd0 con 0x7f93340ce230 2024-09-17T04:35:15.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.134+0000 7f9333fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93340cc4c0 0x7f93340c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:15.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.134+0000 7f9333fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93340cc4c0 0x7f93340c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37248/0 (socket says 172.21.15.43:37248) 2024-09-17T04:35:15.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.134+0000 7f9333fff640 1 -- 172.21.15.43:0/1807871970 learned_addr learned my addr 172.21.15.43:0/1807871970 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:15.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.135+0000 7f93337fe640 1 --2- 172.21.15.43:0/1807871970 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93340ce230 0x7f933414b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:15.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.135+0000 7f9338f2d640 1 --2- 172.21.15.43:0/1807871970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93340ce640 0x7f93340cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:15.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.135+0000 7f9333fff640 1 -- 172.21.15.43:0/1807871970 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93340ce230 msgr2=0x7f933414b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:15.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.135+0000 7f9333fff640 1 --2- 172.21.15.43:0/1807871970 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93340ce230 0x7f933414b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:15.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.135+0000 7f9333fff640 1 -- 172.21.15.43:0/1807871970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93340ce640 msgr2=0x7f93340cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:15.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.135+0000 7f9333fff640 1 --2- 172.21.15.43:0/1807871970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93340ce640 0x7f93340cfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:15.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.135+0000 7f9333fff640 1 -- 172.21.15.43:0/1807871970 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93340c5c90 con 0x7f93340cc4c0 2024-09-17T04:35:15.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.135+0000 7f93337fe640 1 --2- 172.21.15.43:0/1807871970 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93340ce230 0x7f933414b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:35:15.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.135+0000 7f9338f2d640 1 --2- 172.21.15.43:0/1807871970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93340ce640 0x7f93340cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:35:15.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.135+0000 7f9333fff640 1 --2- 172.21.15.43:0/1807871970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93340cc4c0 0x7f93340c5750 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f93240098f0 tx=0x7f9324031720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:15.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.135+0000 7f9330ff9640 1 -- 172.21.15.43:0/1807871970 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9324031950 con 0x7f93340cc4c0 2024-09-17T04:35:15.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.135+0000 7f9330ff9640 1 -- 172.21.15.43:0/1807871970 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9324031be0 con 0x7f93340cc4c0 2024-09-17T04:35:15.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.135+0000 7f933a990640 1 -- 172.21.15.43:0/1807871970 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93340c78c0 con 0x7f93340cc4c0 2024-09-17T04:35:15.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.135+0000 7f9330ff9640 1 -- 172.21.15.43:0/1807871970 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9324005020 con 0x7f93340cc4c0 2024-09-17T04:35:15.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.135+0000 7f933a990640 1 -- 172.21.15.43:0/1807871970 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93340d0920 con 0x7f93340cc4c0 2024-09-17T04:35:15.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.136+0000 7f933a990640 1 -- 172.21.15.43:0/1807871970 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93340b56f0 con 0x7f93340cc4c0 2024-09-17T04:35:15.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.137+0000 7f9330ff9640 1 -- 172.21.15.43:0/1807871970 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f93240051c0 con 0x7f93340cc4c0 2024-09-17T04:35:15.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.138+0000 7f9330ff9640 1 --2- 172.21.15.43:0/1807871970 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9320078b90 0x7f932007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:15.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.138+0000 7f9330ff9640 1 -- 172.21.15.43:0/1807871970 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f93240bc0f0 con 0x7f93340cc4c0 2024-09-17T04:35:15.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.138+0000 7f93337fe640 1 --2- 172.21.15.43:0/1807871970 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9320078b90 0x7f932007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:15.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.138+0000 7f93337fe640 1 --2- 172.21.15.43:0/1807871970 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9320078b90 0x7f932007b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93340cfca0 tx=0x7f9328005f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:15.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.142+0000 7f9330ff9640 1 -- 172.21.15.43:0/1807871970 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f932403f030 con 0x7f93340cc4c0 2024-09-17T04:35:15.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.363+0000 7f933a990640 1 -- 172.21.15.43:0/1807871970 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9334153e90 con 0x7f93340cc4c0 2024-09-17T04:35:15.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.363+0000 7f9330ff9640 1 -- 172.21.15.43:0/1807871970 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7f9324084530 con 0x7f93340cc4c0 2024-09-17T04:35:15.363 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T04:35:15.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.365+0000 7f933a990640 1 -- 172.21.15.43:0/1807871970 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9320078b90 msgr2=0x7f932007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:15.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.365+0000 7f933a990640 1 --2- 172.21.15.43:0/1807871970 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9320078b90 0x7f932007b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93340cfca0 tx=0x7f9328005f10 comp rx=0 tx=0).stop 2024-09-17T04:35:15.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.365+0000 7f933a990640 1 -- 172.21.15.43:0/1807871970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93340cc4c0 msgr2=0x7f93340c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:15.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.365+0000 7f933a990640 1 --2- 172.21.15.43:0/1807871970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93340cc4c0 0x7f93340c5750 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f93240098f0 tx=0x7f9324031720 comp rx=0 tx=0).stop 2024-09-17T04:35:15.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.365+0000 7f933a990640 1 -- 172.21.15.43:0/1807871970 shutdown_connections 2024-09-17T04:35:15.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.365+0000 7f933a990640 1 --2- 172.21.15.43:0/1807871970 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9320078b90 0x7f932007b0a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:15.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.365+0000 7f933a990640 1 --2- 172.21.15.43:0/1807871970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93340ce640 0x7f93340cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:15.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.365+0000 7f933a990640 1 --2- 172.21.15.43:0/1807871970 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93340ce230 0x7f933414b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:15.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.365+0000 7f933a990640 1 --2- 172.21.15.43:0/1807871970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93340cc4c0 0x7f93340c5750 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:15.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.365+0000 7f933a990640 1 -- 172.21.15.43:0/1807871970 >> 172.21.15.43:0/1807871970 conn(0x7f933406f4e0 msgr2=0x7f93340b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:15.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.366+0000 7f933a990640 1 -- 172.21.15.43:0/1807871970 shutdown_connections 2024-09-17T04:35:15.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15.366+0000 7f933a990640 1 -- 172.21.15.43:0/1807871970 wait complete. 2024-09-17T04:35:15.376 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T04:35:15.376 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T04:35:15.377 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-09-17T04:35:15.377 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T04:35:15.377 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T04:35:15.377 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T04:35:15.377 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T04:35:15.377 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T04:35:15.377 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T04:35:15.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:35:15.377 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-09-17T04:35:15.393 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:35:15.393 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:35:15.393 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:35:15.393 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:35:15.394 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-09-17T04:35:15.394 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:35:15.394 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:35:15.394 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-09-17T04:35:15.394 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-09-17T04:35:15.394 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:35:15.394 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-09-17T04:35:15.394 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-09-17T04:35:15.394 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T04:35:15.394 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:35:15.394 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-09-17T04:35:15.394 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T04:35:15.395 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42715sec preferred_lft 42715sec 2024-09-17T04:35:15.395 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link 2024-09-17T04:35:15.395 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:35:15.395 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:35:15.395 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:35:15.395 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-09-17T04:35:15.395 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T04:35:15.395 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:35:15.395 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-09-17T04:35:15.396 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add name ceph-brx type bridge 2024-09-17T04:35:15.396 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr flush dev ceph-brx 2024-09-17T04:35:15.396 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set ceph-brx up 2024-09-17T04:35:15.396 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T04:35:15.396 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-09-17T04:35:15.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:35:15.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:35:15.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:35:15.607 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T04:35:15.633 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-09-17T04:35:15.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:35:15.635 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-09-17T04:35:15.726 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-09-17T04:35:15.726 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T04:35:15.726 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T04:35:15.726 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T04:35:15.726 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T04:35:15.727 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:35:15.727 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-09-17T04:35:15.727 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T04:35:15.727 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T04:35:15.727 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T04:35:15.727 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-09-17T04:35:15.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:35:15.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:35:15.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:35:15.996 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-09-17T04:35:16.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:35:16.013 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2024-09-17T04:35:16.071 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:35:16.071 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-09-17T04:35:16.071 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T04:35:16.071 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T04:35:16.071 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-09-17T04:35:16.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:35:16.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:35:16.193 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T04:35:16.193 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:35:16.193 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-09-17T04:35:16.193 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T04:35:16.193 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T04:35:16.194 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T04:35:16.194 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T04:35:16.194 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T04:35:16.194 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-09-17T04:35:16.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:35:16.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:35:16.327 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:35:16.327 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-09-17T04:35:16.327 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2024-09-17T04:35:16.327 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T04:35:16.327 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-09-17T04:35:16.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:35:16.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:35:16.408 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:35:16.408 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T04:35:16.424 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T04:35:16.424 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:35:16.424 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T04:35:16.480 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-17T04:35:16.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:35:16.481 DEBUG:teuthology.orchestra.run.smithi043:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T04:35:16.590 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T04:35:16.590 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T04:35:16.718 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T04:35:16.718 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T04:35:16.718 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.62:3300,172.21.15.62:3301" 2024-09-17T04:35:16.718 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with new device syntax: 0@cdef1e3e-07e6-43e6-b635-3ed1bc15d64a.cephfs=/ 2024-09-17T04:35:16.718 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.43:3300/172.21.15.62:3300/172.21.15.62:3301" will pass to kernel 2024-09-17T04:35:16.719 INFO:teuthology.orchestra.run.smithi043.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T04:35:16.719 INFO:teuthology.orchestra.run.smithi043.stdout: You just mounted a file system that supports labels which does not 2024-09-17T04:35:16.719 INFO:teuthology.orchestra.run.smithi043.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T04:35:16.719 INFO:teuthology.orchestra.run.smithi043.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T04:35:16.719 INFO:teuthology.orchestra.run.smithi043.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T04:35:16.720 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T04:35:16.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:35:16.721 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T04:35:16.755 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:35:16.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:35:16.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:35:16.863 INFO:teuthology.orchestra.run.smithi043.stdout:client4643 2024-09-17T04:35:16.863 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:35:16.863 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:35:16.880 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:35:16.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:35:16.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:35:16.987 INFO:teuthology.orchestra.run.smithi043.stdout:client4643 2024-09-17T04:35:16.987 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:35:17.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:35:17.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:35:17.051 INFO:teuthology.orchestra.run.smithi043.stdout:client4643 2024-09-17T04:35:17.051 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/cdef1e3e-07e6-43e6-b635-3ed1bc15d64a.client4643/status') 2024-09-17T04:35:17.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:35:17.117 INFO:teuthology.orchestra.run.smithi043.stdout:instance: client.4643 (3)172.21.15.43:0/3780006347 2024-09-17T04:35:17.117 INFO:teuthology.orchestra.run.smithi043.stdout:blocklisted: false 2024-09-17T04:35:17.117 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records in 2024-09-17T04:35:17.117 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records out 2024-09-17T04:35:17.117 INFO:teuthology.orchestra.run.smithi043.stderr:70 bytes copied, 2.8298e-05 s, 2.5 MB/s 2024-09-17T04:35:17.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:35:17.124 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-09-17T04:35:17.151 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-09-17T04:35:17.152 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:35:17.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.268+0000 7f533189b640 1 -- 172.21.15.43:0/1807128219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f532c0ce640 msgr2=0x7f532c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:17.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.268+0000 7f533189b640 1 --2- 172.21.15.43:0/1807128219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f532c0ce640 0x7f532c0b4eb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5324009830 tx=0x7f532402a5a0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.268+0000 7f533189b640 1 -- 172.21.15.43:0/1807128219 shutdown_connections 2024-09-17T04:35:17.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.268+0000 7f533189b640 1 --2- 172.21.15.43:0/1807128219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f532c0ce640 0x7f532c0b4eb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.268+0000 7f533189b640 1 --2- 172.21.15.43:0/1807128219 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f532c0cc4c0 0x7f532c15f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.268+0000 7f533189b640 1 -- 172.21.15.43:0/1807128219 >> 172.21.15.43:0/1807128219 conn(0x7f532c06f4e0 msgr2=0x7f532c06f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:17.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.268+0000 7f533189b640 1 -- 172.21.15.43:0/1807128219 shutdown_connections 2024-09-17T04:35:17.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.268+0000 7f533189b640 1 -- 172.21.15.43:0/1807128219 wait complete. 2024-09-17T04:35:17.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.270+0000 7f533189b640 1 Processor -- start 2024-09-17T04:35:17.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.270+0000 7f533189b640 1 -- start start 2024-09-17T04:35:17.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.271+0000 7f533189b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f532c0cc4c0 0x7f532c157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:17.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.271+0000 7f533189b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f532c0ce230 0x7f532c0cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:17.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.271+0000 7f533189b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f532c0ce640 0x7f532c14e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:17.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.271+0000 7f533189b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f532c15b990 con 0x7f532c0ce230 2024-09-17T04:35:17.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.271+0000 7f533189b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f532c15c2a0 con 0x7f532c0cc4c0 2024-09-17T04:35:17.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.271+0000 7f533189b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f532c0ccbd0 con 0x7f532c0ce640 2024-09-17T04:35:17.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.271+0000 7f532a7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f532c0ce230 0x7f532c0cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:17.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.272+0000 7f532a7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f532c0ce230 0x7f532c0cab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37252/0 (socket says 172.21.15.43:37252) 2024-09-17T04:35:17.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.272+0000 7f532a7fc640 1 -- 172.21.15.43:0/3346920179 learned_addr learned my addr 172.21.15.43:0/3346920179 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:17.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.272+0000 7f532affd640 1 --2- 172.21.15.43:0/3346920179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f532c0cc4c0 0x7f532c157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:17.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.272+0000 7f532b7fe640 1 --2- 172.21.15.43:0/3346920179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f532c0ce640 0x7f532c14e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:17.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.272+0000 7f532a7fc640 1 -- 172.21.15.43:0/3346920179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f532c0ce640 msgr2=0x7f532c14e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:17.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.272+0000 7f532a7fc640 1 --2- 172.21.15.43:0/3346920179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f532c0ce640 0x7f532c14e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.272+0000 7f532a7fc640 1 -- 172.21.15.43:0/3346920179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f532c0cc4c0 msgr2=0x7f532c157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:17.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.272+0000 7f532a7fc640 1 --2- 172.21.15.43:0/3346920179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f532c0cc4c0 0x7f532c157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.272+0000 7f532a7fc640 1 -- 172.21.15.43:0/3346920179 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532c157dd0 con 0x7f532c0ce230 2024-09-17T04:35:17.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.272+0000 7f532a7fc640 1 --2- 172.21.15.43:0/3346920179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f532c0ce230 0x7f532c0cab60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f532000c400 tx=0x7f532000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:17.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.272+0000 7f5313fff640 1 -- 172.21.15.43:0/3346920179 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5320011790 con 0x7f532c0ce230 2024-09-17T04:35:17.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.272+0000 7f5313fff640 1 -- 172.21.15.43:0/3346920179 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5320017070 con 0x7f532c0ce230 2024-09-17T04:35:17.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.272+0000 7f533189b640 1 -- 172.21.15.43:0/3346920179 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f532c1f2780 con 0x7f532c0ce230 2024-09-17T04:35:17.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.272+0000 7f5313fff640 1 -- 172.21.15.43:0/3346920179 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5320011cc0 con 0x7f532c0ce230 2024-09-17T04:35:17.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.272+0000 7f533189b640 1 -- 172.21.15.43:0/3346920179 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f532c1f24a0 con 0x7f532c0ce230 2024-09-17T04:35:17.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.273+0000 7f533189b640 1 -- 172.21.15.43:0/3346920179 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f532c1f2290 con 0x7f532c0ce230 2024-09-17T04:35:17.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.274+0000 7f5313fff640 1 -- 172.21.15.43:0/3346920179 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f532001c460 con 0x7f532c0ce230 2024-09-17T04:35:17.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.275+0000 7f5313fff640 1 --2- 172.21.15.43:0/3346920179 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5318078bc0 0x7f531807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:17.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.275+0000 7f5313fff640 1 -- 172.21.15.43:0/3346920179 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f532009a830 con 0x7f532c0ce230 2024-09-17T04:35:17.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.275+0000 7f532affd640 1 --2- 172.21.15.43:0/3346920179 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5318078bc0 0x7f531807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:17.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.276+0000 7f532affd640 1 --2- 172.21.15.43:0/3346920179 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5318078bc0 0x7f531807b0d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f531c005fd0 tx=0x7f531c009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:17.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.279+0000 7f5313fff640 1 -- 172.21.15.43:0/3346920179 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5320021020 con 0x7f532c0ce230 2024-09-17T04:35:17.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.465+0000 7f533189b640 1 -- 172.21.15.43:0/3346920179 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f532c158c60 con 0x7f532c0ce230 2024-09-17T04:35:17.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.466+0000 7f5313fff640 1 -- 172.21.15.43:0/3346920179 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16641 (secure 0 0 0) 0x7f5320062db0 con 0x7f532c0ce230 2024-09-17T04:35:17.467 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:35:17.467 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":22,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","created":"2024-09-17T04:34:26.485007+0000","modified":"2024-09-17T04:34:53.066747+0000","last_up_change":"2024-09-17T04:34:40.712497+0000","last_in_change":"2024-09-17T04:34:30.384271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:34:38.905735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:34:49.341236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:34:50.401489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eaab925a-60b4-429f-aee1-50de6f32358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6817","nonce":1685480205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6819","nonce":1685480205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6823","nonce":1685480205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6821","nonce":1685480205}]},"public_addr":"172.21.15.43:6817/1685480205","cluster_addr":"172.21.15.43:6819/1685480205","heartbeat_back_addr":"172.21.15.43:6823/1685480205","heartbeat_front_addr":"172.21.15.43:6821/1685480205","state":["exists","up"]},{"osd":1,"uuid":"2c0e64be-db05-45db-aad8-2f2f42812100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6825","nonce":1564354446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6827","nonce":1564354446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6831","nonce":1564354446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6829","nonce":1564354446}]},"public_addr":"172.21.15.43:6825/1564354446","cluster_addr":"172.21.15.43:6827/1564354446","heartbeat_back_addr":"172.21.15.43:6831/1564354446","heartbeat_front_addr":"172.21.15.43:6829/1564354446","state":["exists","up"]},{"osd":2,"uuid":"fa88665d-2acb-4e44-99ac-1d496adf5b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6801","nonce":1385342605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6803","nonce":1385342605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6807","nonce":1385342605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6805","nonce":1385342605}]},"public_addr":"172.21.15.43:6801/1385342605","cluster_addr":"172.21.15.43:6803/1385342605","heartbeat_back_addr":"172.21.15.43:6807/1385342605","heartbeat_front_addr":"172.21.15.43:6805/1385342605","state":["exists","up"]},{"osd":3,"uuid":"710a28f0-d04a-4b4a-bba3-28f7c7b1eb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6809","nonce":1646004903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6811","nonce":1646004903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6815","nonce":1646004903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6813","nonce":1646004903}]},"public_addr":"172.21.15.43:6809/1646004903","cluster_addr":"172.21.15.43:6811/1646004903","heartbeat_back_addr":"172.21.15.43:6815/1646004903","heartbeat_front_addr":"172.21.15.43:6813/1646004903","state":["exists","up"]},{"osd":4,"uuid":"d2eca96b-1917-4dbb-b6e3-f4410bbc5c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6803","nonce":3991694106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6805","nonce":3991694106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6809","nonce":3991694106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6807","nonce":3991694106}]},"public_addr":"172.21.15.62:6803/3991694106","cluster_addr":"172.21.15.62:6805/3991694106","heartbeat_back_addr":"172.21.15.62:6809/3991694106","heartbeat_front_addr":"172.21.15.62:6807/3991694106","state":["exists","up"]},{"osd":5,"uuid":"ae843bea-38ff-4ca6-a7a9-6e58c7a17fd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6827","nonce":2558615114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6829","nonce":2558615114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6833","nonce":2558615114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6831","nonce":2558615114}]},"public_addr":"172.21.15.62:6827/2558615114","cluster_addr":"172.21.15.62:6829/2558615114","heartbeat_back_addr":"172.21.15.62:6833/2558615114","heartbeat_front_addr":"172.21.15.62:6831/2558615114","state":["exists","up"]},{"osd":6,"uuid":"44c53356-010d-443f-9e8d-f0d5da106893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6811","nonce":1901653154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6813","nonce":1901653154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6817","nonce":1901653154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6815","nonce":1901653154}]},"public_addr":"172.21.15.62:6811/1901653154","cluster_addr":"172.21.15.62:6813/1901653154","heartbeat_back_addr":"172.21.15.62:6817/1901653154","heartbeat_front_addr":"172.21.15.62:6815/1901653154","state":["exists","up"]},{"osd":7,"uuid":"c8960d11-dd10-4e36-b9d8-f1fdc0abe9c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6819","nonce":2974376041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6821","nonce":2974376041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6825","nonce":2974376041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6823","nonce":2974376041}]},"public_addr":"172.21.15.62:6819/2974376041","cluster_addr":"172.21.15.62:6821/2974376041","heartbeat_back_addr":"172.21.15.62:6825/2974376041","heartbeat_front_addr":"172.21.15.62:6823/2974376041","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.435063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.372079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:35.973575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.690029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.944690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.691776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.877497+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.689786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:35:17.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.469+0000 7f533189b640 1 -- 172.21.15.43:0/3346920179 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5318078bc0 msgr2=0x7f531807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:17.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.469+0000 7f533189b640 1 --2- 172.21.15.43:0/3346920179 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5318078bc0 0x7f531807b0d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f531c005fd0 tx=0x7f531c009500 comp rx=0 tx=0).stop 2024-09-17T04:35:17.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.469+0000 7f533189b640 1 -- 172.21.15.43:0/3346920179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f532c0ce230 msgr2=0x7f532c0cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:17.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.469+0000 7f533189b640 1 --2- 172.21.15.43:0/3346920179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f532c0ce230 0x7f532c0cab60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f532000c400 tx=0x7f532000c8c0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.469+0000 7f533189b640 1 -- 172.21.15.43:0/3346920179 shutdown_connections 2024-09-17T04:35:17.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.469+0000 7f533189b640 1 --2- 172.21.15.43:0/3346920179 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5318078bc0 0x7f531807b0d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.469+0000 7f533189b640 1 --2- 172.21.15.43:0/3346920179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f532c0ce640 0x7f532c14e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.469+0000 7f533189b640 1 --2- 172.21.15.43:0/3346920179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f532c0ce230 0x7f532c0cab60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.469+0000 7f533189b640 1 --2- 172.21.15.43:0/3346920179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f532c0cc4c0 0x7f532c157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.469+0000 7f533189b640 1 -- 172.21.15.43:0/3346920179 >> 172.21.15.43:0/3346920179 conn(0x7f532c06f4e0 msgr2=0x7f532c0b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:17.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.469+0000 7f533189b640 1 -- 172.21.15.43:0/3346920179 shutdown_connections 2024-09-17T04:35:17.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.469+0000 7f533189b640 1 -- 172.21.15.43:0/3346920179 wait complete. 2024-09-17T04:35:17.480 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T04:34:38.905735+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T04:34:49.341236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T04:34:50.401489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T04:35:17.480 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T04:35:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.601+0000 7f6d97fe6640 1 -- 172.21.15.43:0/316149184 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d900cd980 msgr2=0x7f6d90069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.601+0000 7f6d97fe6640 1 --2- 172.21.15.43:0/316149184 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d900cd980 0x7f6d90069410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009ba0 tx=0x7f6d8802a820 comp rx=0 tx=0).stop 2024-09-17T04:35:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.601+0000 7f6d97fe6640 1 -- 172.21.15.43:0/316149184 shutdown_connections 2024-09-17T04:35:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.601+0000 7f6d97fe6640 1 --2- 172.21.15.43:0/316149184 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d900cd980 0x7f6d90069410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.601+0000 7f6d97fe6640 1 --2- 172.21.15.43:0/316149184 >> v2:172.21.15.62:3300/0 conn(0x7f6d900cbef0 0x7f6d900b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.601+0000 7f6d97fe6640 1 -- 172.21.15.43:0/316149184 >> 172.21.15.43:0/316149184 conn(0x7f6d9006d9f0 msgr2=0x7f6d9006ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.601+0000 7f6d97fe6640 1 -- 172.21.15.43:0/316149184 shutdown_connections 2024-09-17T04:35:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.601+0000 7f6d97fe6640 1 -- 172.21.15.43:0/316149184 wait complete. 2024-09-17T04:35:17.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.602+0000 7f6d97fe6640 1 Processor -- start 2024-09-17T04:35:17.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.603+0000 7f6d97fe6640 1 -- start start 2024-09-17T04:35:17.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d97fe6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d900cbef0 0x7f6d900c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:17.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d97fe6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d900cd570 0x7f6d9014d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:17.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d97fe6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d900cd980 0x7f6d9014bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:17.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d97fe6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6d900cc880 con 0x7f6d900cbef0 2024-09-17T04:35:17.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d97fe6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6d900cc5a0 con 0x7f6d900cd570 2024-09-17T04:35:17.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d97fe6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6d900ccb60 con 0x7f6d900cd980 2024-09-17T04:35:17.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d95d82640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d900cbef0 0x7f6d900c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d95d82640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d900cbef0 0x7f6d900c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37262/0 (socket says 172.21.15.43:37262) 2024-09-17T04:35:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d95d82640 1 -- 172.21.15.43:0/2609509724 learned_addr learned my addr 172.21.15.43:0/2609509724 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d95581640 1 --2- 172.21.15.43:0/2609509724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d900cd570 0x7f6d9014d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d96583640 1 --2- 172.21.15.43:0/2609509724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d900cd980 0x7f6d9014bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d95d82640 1 -- 172.21.15.43:0/2609509724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d900cd980 msgr2=0x7f6d9014bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d95d82640 1 --2- 172.21.15.43:0/2609509724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d900cd980 0x7f6d9014bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d95d82640 1 -- 172.21.15.43:0/2609509724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d900cd570 msgr2=0x7f6d9014d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d95d82640 1 --2- 172.21.15.43:0/2609509724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d900cd570 0x7f6d9014d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d95d82640 1 -- 172.21.15.43:0/2609509724 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d900cb2a0 con 0x7f6d900cbef0 2024-09-17T04:35:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d95581640 1 --2- 172.21.15.43:0/2609509724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d900cd570 0x7f6d9014d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:35:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d96583640 1 --2- 172.21.15.43:0/2609509724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d900cd980 0x7f6d9014bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:35:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.604+0000 7f6d95d82640 1 --2- 172.21.15.43:0/2609509724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d900cbef0 0x7f6d900c8f40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00e790 tx=0x7f6d8c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.605+0000 7f6d867fc640 1 -- 172.21.15.43:0/2609509724 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00eea0 con 0x7f6d900cbef0 2024-09-17T04:35:17.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.605+0000 7f6d867fc640 1 -- 172.21.15.43:0/2609509724 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d8c00cdb0 con 0x7f6d900cbef0 2024-09-17T04:35:17.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.605+0000 7f6d867fc640 1 -- 172.21.15.43:0/2609509724 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c010690 con 0x7f6d900cbef0 2024-09-17T04:35:17.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.605+0000 7f6d97fe6640 1 -- 172.21.15.43:0/2609509724 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d900c9480 con 0x7f6d900cbef0 2024-09-17T04:35:17.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.605+0000 7f6d97fe6640 1 -- 172.21.15.43:0/2609509724 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d900cf5b0 con 0x7f6d900cbef0 2024-09-17T04:35:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.606+0000 7f6d97fe6640 1 -- 172.21.15.43:0/2609509724 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d90155fe0 con 0x7f6d900cbef0 2024-09-17T04:35:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.606+0000 7f6d867fc640 1 -- 172.21.15.43:0/2609509724 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6d8c010830 con 0x7f6d900cbef0 2024-09-17T04:35:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.607+0000 7f6d867fc640 1 --2- 172.21.15.43:0/2609509724 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f6d74078bc0 0x7f6d7407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.607+0000 7f6d867fc640 1 -- 172.21.15.43:0/2609509724 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6d8c09b700 con 0x7f6d900cbef0 2024-09-17T04:35:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.607+0000 7f6d95581640 1 --2- 172.21.15.43:0/2609509724 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f6d74078bc0 0x7f6d7407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.608+0000 7f6d95581640 1 --2- 172.21.15.43:0/2609509724 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f6d74078bc0 0x7f6d7407b0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6d900c6330 tx=0x7f6d80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:17.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.612+0000 7f6d867fc640 1 -- 172.21.15.43:0/2609509724 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6d8c063bc0 con 0x7f6d900cbef0 2024-09-17T04:35:17.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.794+0000 7f6d97fe6640 1 -- 172.21.15.43:0/2609509724 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6d900cb4c0 con 0x7f6d900cbef0 2024-09-17T04:35:17.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.794+0000 7f6d867fc640 1 -- 172.21.15.43:0/2609509724 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f6d8c0634c0 con 0x7f6d900cbef0 2024-09-17T04:35:17.794 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-09-17T04:35:17.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.797+0000 7f6d97fe6640 1 -- 172.21.15.43:0/2609509724 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f6d74078bc0 msgr2=0x7f6d7407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:17.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.797+0000 7f6d97fe6640 1 --2- 172.21.15.43:0/2609509724 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f6d74078bc0 0x7f6d7407b0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6d900c6330 tx=0x7f6d80009040 comp rx=0 tx=0).stop 2024-09-17T04:35:17.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.797+0000 7f6d97fe6640 1 -- 172.21.15.43:0/2609509724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d900cbef0 msgr2=0x7f6d900c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:17.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.797+0000 7f6d97fe6640 1 --2- 172.21.15.43:0/2609509724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d900cbef0 0x7f6d900c8f40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00e790 tx=0x7f6d8c00ec50 comp rx=0 tx=0).stop 2024-09-17T04:35:17.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.797+0000 7f6d97fe6640 1 -- 172.21.15.43:0/2609509724 shutdown_connections 2024-09-17T04:35:17.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.797+0000 7f6d97fe6640 1 --2- 172.21.15.43:0/2609509724 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f6d74078bc0 0x7f6d7407b0d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.797+0000 7f6d97fe6640 1 --2- 172.21.15.43:0/2609509724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d900cd570 0x7f6d9014d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.797+0000 7f6d97fe6640 1 --2- 172.21.15.43:0/2609509724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d900cd980 0x7f6d9014bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.797+0000 7f6d97fe6640 1 --2- 172.21.15.43:0/2609509724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d900cbef0 0x7f6d900c8f40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.797+0000 7f6d97fe6640 1 -- 172.21.15.43:0/2609509724 >> 172.21.15.43:0/2609509724 conn(0x7f6d9006d9f0 msgr2=0x7f6d9015ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:17.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.797+0000 7f6d97fe6640 1 -- 172.21.15.43:0/2609509724 shutdown_connections 2024-09-17T04:35:17.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.797+0000 7f6d97fe6640 1 -- 172.21.15.43:0/2609509724 wait complete. 2024-09-17T04:35:17.808 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-17T04:35:17.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.927+0000 7f88fb4ce640 1 -- 172.21.15.43:0/1535456606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88f415f7b0 msgr2=0x7f88f40c6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:17.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.927+0000 7f88fb4ce640 1 --2- 172.21.15.43:0/1535456606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88f415f7b0 0x7f88f40c6a30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f88f406af20 tx=0x7f88e402a940 comp rx=0 tx=0).stop 2024-09-17T04:35:17.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.927+0000 7f88fb4ce640 1 -- 172.21.15.43:0/1535456606 shutdown_connections 2024-09-17T04:35:17.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.927+0000 7f88fb4ce640 1 --2- 172.21.15.43:0/1535456606 >> v2:172.21.15.62:3300/0 conn(0x7f88f406d1c0 0x7f88f406d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.927+0000 7f88fb4ce640 1 --2- 172.21.15.43:0/1535456606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88f415f7b0 0x7f88f40c6a30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.927+0000 7f88fb4ce640 1 -- 172.21.15.43:0/1535456606 >> 172.21.15.43:0/1535456606 conn(0x7f88f40cdbc0 msgr2=0x7f88f40cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:17.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.927+0000 7f88fb4ce640 1 -- 172.21.15.43:0/1535456606 shutdown_connections 2024-09-17T04:35:17.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.927+0000 7f88fb4ce640 1 -- 172.21.15.43:0/1535456606 wait complete. 2024-09-17T04:35:17.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.929+0000 7f88fb4ce640 1 Processor -- start 2024-09-17T04:35:17.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.929+0000 7f88fb4ce640 1 -- start start 2024-09-17T04:35:17.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.930+0000 7f88fb4ce640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88f406d1c0 0x7f88f41f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:17.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.930+0000 7f88fb4ce640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88f40cd280 0x7f88f4158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:17.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.930+0000 7f88fb4ce640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88f415f7b0 0x7f88f41f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:17.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.930+0000 7f88fb4ce640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f88f40c6290 con 0x7f88f406d1c0 2024-09-17T04:35:17.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.930+0000 7f88fb4ce640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f88f40c5fb0 con 0x7f88f415f7b0 2024-09-17T04:35:17.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.930+0000 7f88fb4ce640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f88f40c6fa0 con 0x7f88f40cd280 2024-09-17T04:35:17.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.930+0000 7f88f926a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88f406d1c0 0x7f88f41f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:17.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.930+0000 7f88f926a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88f406d1c0 0x7f88f41f3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37278/0 (socket says 172.21.15.43:37278) 2024-09-17T04:35:17.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.930+0000 7f88f926a640 1 -- 172.21.15.43:0/4256122647 learned_addr learned my addr 172.21.15.43:0/4256122647 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:17.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.930+0000 7f88f9a6b640 1 --2- 172.21.15.43:0/4256122647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88f415f7b0 0x7f88f41f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:17.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.930+0000 7f88f8a69640 1 --2- 172.21.15.43:0/4256122647 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88f40cd280 0x7f88f4158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:17.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.931+0000 7f88f926a640 1 -- 172.21.15.43:0/4256122647 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88f40cd280 msgr2=0x7f88f4158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:17.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.931+0000 7f88f926a640 1 --2- 172.21.15.43:0/4256122647 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88f40cd280 0x7f88f4158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.931+0000 7f88f926a640 1 -- 172.21.15.43:0/4256122647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88f415f7b0 msgr2=0x7f88f41f4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:17.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.931+0000 7f88f926a640 1 --2- 172.21.15.43:0/4256122647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88f415f7b0 0x7f88f41f4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:17.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.931+0000 7f88f926a640 1 -- 172.21.15.43:0/4256122647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f41f3bc0 con 0x7f88f406d1c0 2024-09-17T04:35:17.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.931+0000 7f88f926a640 1 --2- 172.21.15.43:0/4256122647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88f406d1c0 0x7f88f41f3680 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f88e4031ea0 tx=0x7f88e4031ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:17.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.931+0000 7f88f1ffb640 1 -- 172.21.15.43:0/4256122647 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e403e070 con 0x7f88f406d1c0 2024-09-17T04:35:17.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.931+0000 7f88f1ffb640 1 -- 172.21.15.43:0/4256122647 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88e4004540 con 0x7f88f406d1c0 2024-09-17T04:35:17.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.931+0000 7f88fb4ce640 1 -- 172.21.15.43:0/4256122647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f40cad00 con 0x7f88f406d1c0 2024-09-17T04:35:17.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.931+0000 7f88f1ffb640 1 -- 172.21.15.43:0/4256122647 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e4043460 con 0x7f88f406d1c0 2024-09-17T04:35:17.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.931+0000 7f88fb4ce640 1 -- 172.21.15.43:0/4256122647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f41f3160 con 0x7f88f406d1c0 2024-09-17T04:35:17.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.932+0000 7f88fb4ce640 1 -- 172.21.15.43:0/4256122647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88f40c6a30 con 0x7f88f406d1c0 2024-09-17T04:35:17.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.933+0000 7f88f1ffb640 1 -- 172.21.15.43:0/4256122647 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f88e4043600 con 0x7f88f406d1c0 2024-09-17T04:35:17.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.934+0000 7f88f1ffb640 1 --2- 172.21.15.43:0/4256122647 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f88e0078b90 0x7f88e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:17.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.934+0000 7f88f1ffb640 1 -- 172.21.15.43:0/4256122647 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f88e40bc7d0 con 0x7f88f406d1c0 2024-09-17T04:35:17.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.934+0000 7f88f8a69640 1 --2- 172.21.15.43:0/4256122647 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f88e0078b90 0x7f88e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:17.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.935+0000 7f88f8a69640 1 --2- 172.21.15.43:0/4256122647 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f88e0078b90 0x7f88e007b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f88e8000f60 tx=0x7f88e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:17.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:17.939+0000 7f88f1ffb640 1 -- 172.21.15.43:0/4256122647 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f88e4084660 con 0x7f88f406d1c0 2024-09-17T04:35:18.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.122+0000 7f88fb4ce640 1 -- 172.21.15.43:0/4256122647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f88f40b3a20 con 0x7f88f406d1c0 2024-09-17T04:35:18.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.123+0000 7f88f1ffb640 1 -- 172.21.15.43:0/4256122647 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f88e4089090 con 0x7f88f406d1c0 2024-09-17T04:35:18.123 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-09-17T04:35:18.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.125+0000 7f88fb4ce640 1 -- 172.21.15.43:0/4256122647 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f88e0078b90 msgr2=0x7f88e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:18.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.125+0000 7f88fb4ce640 1 --2- 172.21.15.43:0/4256122647 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f88e0078b90 0x7f88e007b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f88e8000f60 tx=0x7f88e8009040 comp rx=0 tx=0).stop 2024-09-17T04:35:18.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.125+0000 7f88fb4ce640 1 -- 172.21.15.43:0/4256122647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88f406d1c0 msgr2=0x7f88f41f3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:18.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.125+0000 7f88fb4ce640 1 --2- 172.21.15.43:0/4256122647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88f406d1c0 0x7f88f41f3680 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f88e4031ea0 tx=0x7f88e4031ed0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.125+0000 7f88fb4ce640 1 -- 172.21.15.43:0/4256122647 shutdown_connections 2024-09-17T04:35:18.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.125+0000 7f88fb4ce640 1 --2- 172.21.15.43:0/4256122647 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f88e0078b90 0x7f88e007b0a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.125+0000 7f88fb4ce640 1 --2- 172.21.15.43:0/4256122647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88f415f7b0 0x7f88f41f4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.125+0000 7f88fb4ce640 1 --2- 172.21.15.43:0/4256122647 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88f40cd280 0x7f88f4158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.125+0000 7f88fb4ce640 1 --2- 172.21.15.43:0/4256122647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88f406d1c0 0x7f88f41f3680 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.125+0000 7f88fb4ce640 1 -- 172.21.15.43:0/4256122647 >> 172.21.15.43:0/4256122647 conn(0x7f88f40cdbc0 msgr2=0x7f88f41535e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:18.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.125+0000 7f88fb4ce640 1 -- 172.21.15.43:0/4256122647 shutdown_connections 2024-09-17T04:35:18.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.125+0000 7f88fb4ce640 1 -- 172.21.15.43:0/4256122647 wait complete. 2024-09-17T04:35:18.136 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-17T04:35:18.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.257+0000 7fac970c5640 1 -- 172.21.15.43:0/4012970882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac80005350 msgr2=0x7fac8000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:18.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.257+0000 7fac970c5640 1 --2- 172.21.15.43:0/4012970882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac80005350 0x7fac8000b9c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fac880013d0 tx=0x7fac80005830 comp rx=0 tx=0).stop 2024-09-17T04:35:18.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.257+0000 7fac970c5640 1 -- 172.21.15.43:0/4012970882 shutdown_connections 2024-09-17T04:35:18.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.257+0000 7fac970c5640 1 --2- 172.21.15.43:0/4012970882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac80005350 0x7fac8000b9c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.257+0000 7fac970c5640 1 -- 172.21.15.43:0/4012970882 >> 172.21.15.43:0/4012970882 conn(0x7fac900cdbc0 msgr2=0x7fac900cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:18.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.257+0000 7fac970c5640 1 -- 172.21.15.43:0/4012970882 shutdown_connections 2024-09-17T04:35:18.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.257+0000 7fac970c5640 1 -- 172.21.15.43:0/4012970882 wait complete. 2024-09-17T04:35:18.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.259+0000 7fac970c5640 1 Processor -- start 2024-09-17T04:35:18.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.259+0000 7fac970c5640 1 -- start start 2024-09-17T04:35:18.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.260+0000 7fac970c5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac80005350 0x7fac901f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:18.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.260+0000 7fac970c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac90152480 0x7fac9014a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:18.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.260+0000 7fac970c5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac90152890 0x7fac9014a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:18.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.260+0000 7fac970c5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fac900b4e20 con 0x7fac80005350 2024-09-17T04:35:18.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.260+0000 7fac970c5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fac9006da70 con 0x7fac90152480 2024-09-17T04:35:18.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.260+0000 7fac970c5640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fac9008e480 con 0x7fac90152890 2024-09-17T04:35:18.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.260+0000 7fac94e61640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac80005350 0x7fac901f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:18.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.260+0000 7fac94e61640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac80005350 0x7fac901f6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37302/0 (socket says 172.21.15.43:37302) 2024-09-17T04:35:18.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.260+0000 7fac94e61640 1 -- 172.21.15.43:0/2069442831 learned_addr learned my addr 172.21.15.43:0/2069442831 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:18.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.260+0000 7fac8ffff640 1 --2- 172.21.15.43:0/2069442831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac90152480 0x7fac9014a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:18.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.260+0000 7fac95662640 1 --2- 172.21.15.43:0/2069442831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac90152890 0x7fac9014a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:18.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.260+0000 7fac94e61640 1 -- 172.21.15.43:0/2069442831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac90152890 msgr2=0x7fac9014a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:18.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.260+0000 7fac94e61640 1 --2- 172.21.15.43:0/2069442831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac90152890 0x7fac9014a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.260+0000 7fac94e61640 1 -- 172.21.15.43:0/2069442831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac90152480 msgr2=0x7fac9014a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:18.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.260+0000 7fac94e61640 1 --2- 172.21.15.43:0/2069442831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac90152480 0x7fac9014a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.260+0000 7fac94e61640 1 -- 172.21.15.43:0/2069442831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac901f5c80 con 0x7fac80005350 2024-09-17T04:35:18.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.261+0000 7fac94e61640 1 --2- 172.21.15.43:0/2069442831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac80005350 0x7fac901f6740 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fac84003ed0 tx=0x7fac84001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:18.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.261+0000 7fac8d7fa640 1 -- 172.21.15.43:0/2069442831 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84015070 con 0x7fac80005350 2024-09-17T04:35:18.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.261+0000 7fac8d7fa640 1 -- 172.21.15.43:0/2069442831 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac84011640 con 0x7fac80005350 2024-09-17T04:35:18.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.261+0000 7fac970c5640 1 -- 172.21.15.43:0/2069442831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac90155230 con 0x7fac80005350 2024-09-17T04:35:18.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.261+0000 7fac8d7fa640 1 -- 172.21.15.43:0/2069442831 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84011a90 con 0x7fac80005350 2024-09-17T04:35:18.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.261+0000 7fac970c5640 1 -- 172.21.15.43:0/2069442831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac900cae00 con 0x7fac80005350 2024-09-17T04:35:18.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.262+0000 7fac970c5640 1 -- 172.21.15.43:0/2069442831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac900cd620 con 0x7fac80005350 2024-09-17T04:35:18.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.263+0000 7fac8d7fa640 1 -- 172.21.15.43:0/2069442831 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fac84018070 con 0x7fac80005350 2024-09-17T04:35:18.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.263+0000 7fac8d7fa640 1 --2- 172.21.15.43:0/2069442831 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fac74078bc0 0x7fac7407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:18.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.263+0000 7fac8d7fa640 1 -- 172.21.15.43:0/2069442831 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fac8409b760 con 0x7fac80005350 2024-09-17T04:35:18.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.264+0000 7fac8ffff640 1 --2- 172.21.15.43:0/2069442831 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fac74078bc0 0x7fac7407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:18.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.264+0000 7fac8ffff640 1 --2- 172.21.15.43:0/2069442831 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fac74078bc0 0x7fac7407b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fac7c009bd0 tx=0x7fac7c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:18.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.268+0000 7fac8d7fa640 1 -- 172.21.15.43:0/2069442831 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fac900cd620 con 0x7fac80005350 2024-09-17T04:35:18.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.451+0000 7fac970c5640 1 -- 172.21.15.43:0/2069442831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fac9015c290 con 0x7fac80005350 2024-09-17T04:35:18.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.451+0000 7fac8d7fa640 1 -- 172.21.15.43:0/2069442831 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fac84063540 con 0x7fac80005350 2024-09-17T04:35:18.451 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-09-17T04:35:18.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.453+0000 7fac970c5640 1 -- 172.21.15.43:0/2069442831 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fac74078bc0 msgr2=0x7fac7407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:18.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.453+0000 7fac970c5640 1 --2- 172.21.15.43:0/2069442831 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fac74078bc0 0x7fac7407b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fac7c009bd0 tx=0x7fac7c005f90 comp rx=0 tx=0).stop 2024-09-17T04:35:18.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.453+0000 7fac970c5640 1 -- 172.21.15.43:0/2069442831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac80005350 msgr2=0x7fac901f6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:18.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.453+0000 7fac970c5640 1 --2- 172.21.15.43:0/2069442831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac80005350 0x7fac901f6740 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fac84003ed0 tx=0x7fac84001630 comp rx=0 tx=0).stop 2024-09-17T04:35:18.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.453+0000 7fac970c5640 1 -- 172.21.15.43:0/2069442831 shutdown_connections 2024-09-17T04:35:18.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.453+0000 7fac970c5640 1 --2- 172.21.15.43:0/2069442831 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fac74078bc0 0x7fac7407b0d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.453+0000 7fac970c5640 1 --2- 172.21.15.43:0/2069442831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac90152480 0x7fac9014a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.453+0000 7fac970c5640 1 --2- 172.21.15.43:0/2069442831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac90152890 0x7fac9014a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.453+0000 7fac970c5640 1 --2- 172.21.15.43:0/2069442831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac80005350 0x7fac901f6740 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.453+0000 7fac970c5640 1 -- 172.21.15.43:0/2069442831 >> 172.21.15.43:0/2069442831 conn(0x7fac900cdbc0 msgr2=0x7fac900cc210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:18.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.453+0000 7fac970c5640 1 -- 172.21.15.43:0/2069442831 shutdown_connections 2024-09-17T04:35:18.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.453+0000 7fac970c5640 1 -- 172.21.15.43:0/2069442831 wait complete. 2024-09-17T04:35:18.465 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-09-17T04:35:18.465 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:35:18.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.582+0000 7fca3dd0b640 1 -- 172.21.15.43:0/2836900540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca380c6f00 msgr2=0x7fca380d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:18.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.582+0000 7fca3dd0b640 1 --2- 172.21.15.43:0/2836900540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca380c6f00 0x7fca380d15a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fca380c80b0 tx=0x7fca2802a5c0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.582+0000 7fca3dd0b640 1 -- 172.21.15.43:0/2836900540 shutdown_connections 2024-09-17T04:35:18.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.582+0000 7fca3dd0b640 1 --2- 172.21.15.43:0/2836900540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca380c6f00 0x7fca380d15a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.582+0000 7fca3dd0b640 1 -- 172.21.15.43:0/2836900540 >> 172.21.15.43:0/2836900540 conn(0x7fca3806f460 msgr2=0x7fca3806f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:18.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.582+0000 7fca3dd0b640 1 -- 172.21.15.43:0/2836900540 shutdown_connections 2024-09-17T04:35:18.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.582+0000 7fca3dd0b640 1 -- 172.21.15.43:0/2836900540 wait complete. 2024-09-17T04:35:18.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.584+0000 7fca3dd0b640 1 Processor -- start 2024-09-17T04:35:18.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.584+0000 7fca3dd0b640 1 -- start start 2024-09-17T04:35:18.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.585+0000 7fca3dd0b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca380c69b0 0x7fca38154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:18.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.585+0000 7fca3dd0b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca380c6f00 0x7fca3814f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:18.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.585+0000 7fca3dd0b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca38155d40 0x7fca3814b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:18.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.585+0000 7fca3dd0b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fca380c7730 con 0x7fca380c6f00 2024-09-17T04:35:18.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.585+0000 7fca3dd0b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fca380c7aa0 con 0x7fca38155d40 2024-09-17T04:35:18.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.585+0000 7fca3dd0b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fca380b4d50 con 0x7fca380c69b0 2024-09-17T04:35:18.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.585+0000 7fca36ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca380c6f00 0x7fca3814f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:18.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.585+0000 7fca36ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca380c6f00 0x7fca3814f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37324/0 (socket says 172.21.15.43:37324) 2024-09-17T04:35:18.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.585+0000 7fca36ffd640 1 -- 172.21.15.43:0/633825034 learned_addr learned my addr 172.21.15.43:0/633825034 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:18.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.585+0000 7fca377fe640 1 --2- 172.21.15.43:0/633825034 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca380c69b0 0x7fca38154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:18.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.585+0000 7fca37fff640 1 --2- 172.21.15.43:0/633825034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca38155d40 0x7fca3814b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:18.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.586+0000 7fca36ffd640 1 -- 172.21.15.43:0/633825034 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca380c69b0 msgr2=0x7fca38154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:18.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.586+0000 7fca36ffd640 1 --2- 172.21.15.43:0/633825034 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca380c69b0 0x7fca38154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.586+0000 7fca36ffd640 1 -- 172.21.15.43:0/633825034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca38155d40 msgr2=0x7fca3814b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:18.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.586+0000 7fca36ffd640 1 --2- 172.21.15.43:0/633825034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca38155d40 0x7fca3814b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.586+0000 7fca36ffd640 1 -- 172.21.15.43:0/633825034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca38155080 con 0x7fca380c6f00 2024-09-17T04:35:18.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.586+0000 7fca36ffd640 1 --2- 172.21.15.43:0/633825034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca380c6f00 0x7fca3814f3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00c3d0 tx=0x7fca2c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:18.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.586+0000 7fca1ffff640 1 -- 172.21.15.43:0/633825034 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c017070 con 0x7fca380c6f00 2024-09-17T04:35:18.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.586+0000 7fca1ffff640 1 -- 172.21.15.43:0/633825034 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca2c0053c0 con 0x7fca380c6f00 2024-09-17T04:35:18.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.586+0000 7fca1ffff640 1 -- 172.21.15.43:0/633825034 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c003850 con 0x7fca380c6f00 2024-09-17T04:35:18.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.586+0000 7fca3dd0b640 1 -- 172.21.15.43:0/633825034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca3814edc0 con 0x7fca380c6f00 2024-09-17T04:35:18.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.586+0000 7fca3dd0b640 1 -- 172.21.15.43:0/633825034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca3815e690 con 0x7fca380c6f00 2024-09-17T04:35:18.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.587+0000 7fca3dd0b640 1 -- 172.21.15.43:0/633825034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca380cc720 con 0x7fca380c6f00 2024-09-17T04:35:18.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.588+0000 7fca1ffff640 1 -- 172.21.15.43:0/633825034 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca2c01a070 con 0x7fca380c6f00 2024-09-17T04:35:18.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.589+0000 7fca1ffff640 1 --2- 172.21.15.43:0/633825034 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fca24078bc0 0x7fca2407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:18.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.589+0000 7fca1ffff640 1 -- 172.21.15.43:0/633825034 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fca2c09a080 con 0x7fca380c6f00 2024-09-17T04:35:18.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.589+0000 7fca377fe640 1 --2- 172.21.15.43:0/633825034 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fca24078bc0 0x7fca2407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:18.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.589+0000 7fca377fe640 1 --2- 172.21.15.43:0/633825034 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fca24078bc0 0x7fca2407b0d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fca28034000 tx=0x7fca28004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:18.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.593+0000 7fca1ffff640 1 -- 172.21.15.43:0/633825034 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fca2c061e60 con 0x7fca380c6f00 2024-09-17T04:35:18.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.773+0000 7fca3dd0b640 1 -- 172.21.15.43:0/633825034 --> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca380b3d30 con 0x7fca24078bc0 2024-09-17T04:35:18.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.778+0000 7fca1ffff640 1 -- 172.21.15.43:0/633825034 <== mgr.4100 v2:172.21.15.62:6800/1186143747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251880 (secure 0 0 0) 0x7fca380b3d30 con 0x7fca24078bc0 2024-09-17T04:35:18.780 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:35:18.782 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-17T04:35:18.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.781+0000 7fca3dd0b640 1 -- 172.21.15.43:0/633825034 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fca24078bc0 msgr2=0x7fca2407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:18.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.781+0000 7fca3dd0b640 1 --2- 172.21.15.43:0/633825034 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fca24078bc0 0x7fca2407b0d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fca28034000 tx=0x7fca28004730 comp rx=0 tx=0).stop 2024-09-17T04:35:18.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.781+0000 7fca3dd0b640 1 -- 172.21.15.43:0/633825034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca380c6f00 msgr2=0x7fca3814f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:18.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.781+0000 7fca3dd0b640 1 --2- 172.21.15.43:0/633825034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca380c6f00 0x7fca3814f3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00c3d0 tx=0x7fca2c00c890 comp rx=0 tx=0).stop 2024-09-17T04:35:18.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.782+0000 7fca3dd0b640 1 -- 172.21.15.43:0/633825034 shutdown_connections 2024-09-17T04:35:18.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.782+0000 7fca3dd0b640 1 --2- 172.21.15.43:0/633825034 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fca24078bc0 0x7fca2407b0d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.782+0000 7fca3dd0b640 1 --2- 172.21.15.43:0/633825034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca38155d40 0x7fca3814b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.782+0000 7fca3dd0b640 1 --2- 172.21.15.43:0/633825034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca380c6f00 0x7fca3814f3c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.782+0000 7fca3dd0b640 1 --2- 172.21.15.43:0/633825034 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca380c69b0 0x7fca38154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.782+0000 7fca3dd0b640 1 -- 172.21.15.43:0/633825034 >> 172.21.15.43:0/633825034 conn(0x7fca3806f460 msgr2=0x7fca380d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:18.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.782+0000 7fca3dd0b640 1 -- 172.21.15.43:0/633825034 shutdown_connections 2024-09-17T04:35:18.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.782+0000 7fca3dd0b640 1 -- 172.21.15.43:0/633825034 wait complete. 2024-09-17T04:35:18.793 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-17T04:35:16.895774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595590,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":226,"num_write_kb":1666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240008,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734712,"statfs":{"total":773094113280,"available":772848345088,"internally_reserved":0,"allocated":3088384,"data_stored":1803548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1518,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002996"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079958+0000","last_change":"2024-09-17T04:34:52.082794+0000","last_active":"2024-09-17T04:34:53.079958+0000","last_peered":"2024-09-17T04:34:53.079958+0000","last_clean":"2024-09-17T04:34:53.079958+0000","last_became_active":"2024-09-17T04:34:52.081216+0000","last_became_peered":"2024-09-17T04:34:52.081216+0000","last_unstale":"2024-09-17T04:34:53.079958+0000","last_undegraded":"2024-09-17T04:34:53.079958+0000","last_fullsized":"2024-09-17T04:34:53.079958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:32.229667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075998+0000","last_change":"2024-09-17T04:34:52.071762+0000","last_active":"2024-09-17T04:34:53.075998+0000","last_peered":"2024-09-17T04:34:53.075998+0000","last_clean":"2024-09-17T04:34:53.075998+0000","last_became_active":"2024-09-17T04:34:52.071488+0000","last_became_peered":"2024-09-17T04:34:52.071488+0000","last_unstale":"2024-09-17T04:34:53.075998+0000","last_undegraded":"2024-09-17T04:34:53.075998+0000","last_fullsized":"2024-09-17T04:34:53.075998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:00.729921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315645+0000","last_change":"2024-09-17T04:34:52.073360+0000","last_active":"2024-09-17T04:34:53.315645+0000","last_peered":"2024-09-17T04:34:53.315645+0000","last_clean":"2024-09-17T04:34:53.315645+0000","last_became_active":"2024-09-17T04:34:52.073014+0000","last_became_peered":"2024-09-17T04:34:52.073014+0000","last_unstale":"2024-09-17T04:34:53.315645+0000","last_undegraded":"2024-09-17T04:34:53.315645+0000","last_fullsized":"2024-09-17T04:34:53.315645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:14.331608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081622+0000","last_change":"2024-09-17T04:34:52.077679+0000","last_active":"2024-09-17T04:34:53.081622+0000","last_peered":"2024-09-17T04:34:53.081622+0000","last_clean":"2024-09-17T04:34:53.081622+0000","last_became_active":"2024-09-17T04:34:52.077306+0000","last_became_peered":"2024-09-17T04:34:52.077306+0000","last_unstale":"2024-09-17T04:34:53.081622+0000","last_undegraded":"2024-09-17T04:34:53.081622+0000","last_fullsized":"2024-09-17T04:34:53.081622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:44.967159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080748+0000","last_change":"2024-09-17T04:34:52.075036+0000","last_active":"2024-09-17T04:34:53.080748+0000","last_peered":"2024-09-17T04:34:53.080748+0000","last_clean":"2024-09-17T04:34:53.080748+0000","last_became_active":"2024-09-17T04:34:52.074649+0000","last_became_peered":"2024-09-17T04:34:52.074649+0000","last_unstale":"2024-09-17T04:34:53.080748+0000","last_undegraded":"2024-09-17T04:34:53.080748+0000","last_fullsized":"2024-09-17T04:34:53.080748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:22.293746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081410+0000","last_change":"2024-09-17T04:34:52.081059+0000","last_active":"2024-09-17T04:34:53.081410+0000","last_peered":"2024-09-17T04:34:53.081410+0000","last_clean":"2024-09-17T04:34:53.081410+0000","last_became_active":"2024-09-17T04:34:52.080677+0000","last_became_peered":"2024-09-17T04:34:52.080677+0000","last_unstale":"2024-09-17T04:34:53.081410+0000","last_undegraded":"2024-09-17T04:34:53.081410+0000","last_fullsized":"2024-09-17T04:34:53.081410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:52.404672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079328+0000","last_change":"2024-09-17T04:34:52.071135+0000","last_active":"2024-09-17T04:34:53.079328+0000","last_peered":"2024-09-17T04:34:53.079328+0000","last_clean":"2024-09-17T04:34:53.079328+0000","last_became_active":"2024-09-17T04:34:52.070844+0000","last_became_peered":"2024-09-17T04:34:52.070844+0000","last_unstale":"2024-09-17T04:34:53.079328+0000","last_undegraded":"2024-09-17T04:34:53.079328+0000","last_fullsized":"2024-09-17T04:34:53.079328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:02.373675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176836+0000","last_change":"2024-09-17T04:34:52.083343+0000","last_active":"2024-09-17T04:34:53.176836+0000","last_peered":"2024-09-17T04:34:53.176836+0000","last_clean":"2024-09-17T04:34:53.176836+0000","last_became_active":"2024-09-17T04:34:52.083008+0000","last_became_peered":"2024-09-17T04:34:52.083008+0000","last_unstale":"2024-09-17T04:34:53.176836+0000","last_undegraded":"2024-09-17T04:34:53.176836+0000","last_fullsized":"2024-09-17T04:34:53.176836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:02.710077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079639+0000","last_change":"2024-09-17T04:34:52.083331+0000","last_active":"2024-09-17T04:34:53.079639+0000","last_peered":"2024-09-17T04:34:53.079639+0000","last_clean":"2024-09-17T04:34:53.079639+0000","last_became_active":"2024-09-17T04:34:52.082984+0000","last_became_peered":"2024-09-17T04:34:52.082984+0000","last_unstale":"2024-09-17T04:34:53.079639+0000","last_undegraded":"2024-09-17T04:34:53.079639+0000","last_fullsized":"2024-09-17T04:34:53.079639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:56.779776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080623+0000","last_change":"2024-09-17T04:34:52.087207+0000","last_active":"2024-09-17T04:34:53.080623+0000","last_peered":"2024-09-17T04:34:53.080623+0000","last_clean":"2024-09-17T04:34:53.080623+0000","last_became_active":"2024-09-17T04:34:52.086885+0000","last_became_peered":"2024-09-17T04:34:52.086885+0000","last_unstale":"2024-09-17T04:34:53.080623+0000","last_undegraded":"2024-09-17T04:34:53.080623+0000","last_fullsized":"2024-09-17T04:34:53.080623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:52.121338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.078802+0000","last_change":"2024-09-17T04:34:52.086309+0000","last_active":"2024-09-17T04:34:53.078802+0000","last_peered":"2024-09-17T04:34:53.078802+0000","last_clean":"2024-09-17T04:34:53.078802+0000","last_became_active":"2024-09-17T04:34:52.085996+0000","last_became_peered":"2024-09-17T04:34:52.085996+0000","last_unstale":"2024-09-17T04:34:53.078802+0000","last_undegraded":"2024-09-17T04:34:53.078802+0000","last_fullsized":"2024-09-17T04:34:53.078802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:58.004980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318081+0000","last_change":"2024-09-17T04:34:52.077080+0000","last_active":"2024-09-17T04:34:53.318081+0000","last_peered":"2024-09-17T04:34:53.318081+0000","last_clean":"2024-09-17T04:34:53.318081+0000","last_became_active":"2024-09-17T04:34:52.076756+0000","last_became_peered":"2024-09-17T04:34:52.076756+0000","last_unstale":"2024-09-17T04:34:53.318081+0000","last_undegraded":"2024-09-17T04:34:53.318081+0000","last_fullsized":"2024-09-17T04:34:53.318081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:48.044400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177180+0000","last_change":"2024-09-17T04:34:52.076609+0000","last_active":"2024-09-17T04:34:53.177180+0000","last_peered":"2024-09-17T04:34:53.177180+0000","last_clean":"2024-09-17T04:34:53.177180+0000","last_became_active":"2024-09-17T04:34:52.076277+0000","last_became_peered":"2024-09-17T04:34:52.076277+0000","last_unstale":"2024-09-17T04:34:53.177180+0000","last_undegraded":"2024-09-17T04:34:53.177180+0000","last_fullsized":"2024-09-17T04:34:53.177180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:28.537566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315331+0000","last_change":"2024-09-17T04:34:52.076754+0000","last_active":"2024-09-17T04:34:53.315331+0000","last_peered":"2024-09-17T04:34:53.315331+0000","last_clean":"2024-09-17T04:34:53.315331+0000","last_became_active":"2024-09-17T04:34:52.076261+0000","last_became_peered":"2024-09-17T04:34:52.076261+0000","last_unstale":"2024-09-17T04:34:53.315331+0000","last_undegraded":"2024-09-17T04:34:53.315331+0000","last_fullsized":"2024-09-17T04:34:53.315331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:51.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075849+0000","last_change":"2024-09-17T04:34:52.079161+0000","last_active":"2024-09-17T04:34:53.075849+0000","last_peered":"2024-09-17T04:34:53.075849+0000","last_clean":"2024-09-17T04:34:53.075849+0000","last_became_active":"2024-09-17T04:34:52.078782+0000","last_became_peered":"2024-09-17T04:34:52.078782+0000","last_unstale":"2024-09-17T04:34:53.075849+0000","last_undegraded":"2024-09-17T04:34:53.075849+0000","last_fullsized":"2024-09-17T04:34:53.075849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:06.894137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080646+0000","last_change":"2024-09-17T04:34:52.070767+0000","last_active":"2024-09-17T04:34:53.080646+0000","last_peered":"2024-09-17T04:34:53.080646+0000","last_clean":"2024-09-17T04:34:53.080646+0000","last_became_active":"2024-09-17T04:34:52.070428+0000","last_became_peered":"2024-09-17T04:34:52.070428+0000","last_unstale":"2024-09-17T04:34:53.080646+0000","last_undegraded":"2024-09-17T04:34:53.080646+0000","last_fullsized":"2024-09-17T04:34:53.080646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:42.820391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.082014+0000","last_change":"2024-09-17T04:34:52.077238+0000","last_active":"2024-09-17T04:34:53.082014+0000","last_peered":"2024-09-17T04:34:53.082014+0000","last_clean":"2024-09-17T04:34:53.082014+0000","last_became_active":"2024-09-17T04:34:52.076897+0000","last_became_peered":"2024-09-17T04:34:52.076897+0000","last_unstale":"2024-09-17T04:34:53.082014+0000","last_undegraded":"2024-09-17T04:34:53.082014+0000","last_fullsized":"2024-09-17T04:34:53.082014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:27.431184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.316114+0000","last_change":"2024-09-17T04:34:52.080917+0000","last_active":"2024-09-17T04:34:53.316114+0000","last_peered":"2024-09-17T04:34:53.316114+0000","last_clean":"2024-09-17T04:34:53.316114+0000","last_became_active":"2024-09-17T04:34:52.080597+0000","last_became_peered":"2024-09-17T04:34:52.080597+0000","last_unstale":"2024-09-17T04:34:53.316114+0000","last_undegraded":"2024-09-17T04:34:53.316114+0000","last_fullsized":"2024-09-17T04:34:53.316114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:10.560075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080159+0000","last_change":"2024-09-17T04:34:52.077284+0000","last_active":"2024-09-17T04:34:53.080159+0000","last_peered":"2024-09-17T04:34:53.080159+0000","last_clean":"2024-09-17T04:34:53.080159+0000","last_became_active":"2024-09-17T04:34:52.076950+0000","last_became_peered":"2024-09-17T04:34:52.076950+0000","last_unstale":"2024-09-17T04:34:53.080159+0000","last_undegraded":"2024-09-17T04:34:53.080159+0000","last_fullsized":"2024-09-17T04:34:53.080159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:06.361530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079837+0000","last_change":"2024-09-17T04:34:52.083859+0000","last_active":"2024-09-17T04:34:53.079837+0000","last_peered":"2024-09-17T04:34:53.079837+0000","last_clean":"2024-09-17T04:34:53.079837+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:34:53.079837+0000","last_undegraded":"2024-09-17T04:34:53.079837+0000","last_fullsized":"2024-09-17T04:34:53.079837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:25.262925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315556+0000","last_change":"2024-09-17T04:34:52.086460+0000","last_active":"2024-09-17T04:34:53.315556+0000","last_peered":"2024-09-17T04:34:53.315556+0000","last_clean":"2024-09-17T04:34:53.315556+0000","last_became_active":"2024-09-17T04:34:52.084848+0000","last_became_peered":"2024-09-17T04:34:52.084848+0000","last_unstale":"2024-09-17T04:34:53.315556+0000","last_undegraded":"2024-09-17T04:34:53.315556+0000","last_fullsized":"2024-09-17T04:34:53.315556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:22.927331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081424+0000","last_change":"2024-09-17T04:34:52.080149+0000","last_active":"2024-09-17T04:34:53.081424+0000","last_peered":"2024-09-17T04:34:53.081424+0000","last_clean":"2024-09-17T04:34:53.081424+0000","last_became_active":"2024-09-17T04:34:52.079490+0000","last_became_peered":"2024-09-17T04:34:52.079490+0000","last_unstale":"2024-09-17T04:34:53.081424+0000","last_undegraded":"2024-09-17T04:34:53.081424+0000","last_fullsized":"2024-09-17T04:34:53.081424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:52.314715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176860+0000","last_change":"2024-09-17T04:34:52.082765+0000","last_active":"2024-09-17T04:34:53.176860+0000","last_peered":"2024-09-17T04:34:53.176860+0000","last_clean":"2024-09-17T04:34:53.176860+0000","last_became_active":"2024-09-17T04:34:52.081049+0000","last_became_peered":"2024-09-17T04:34:52.081049+0000","last_unstale":"2024-09-17T04:34:53.176860+0000","last_undegraded":"2024-09-17T04:34:53.176860+0000","last_fullsized":"2024-09-17T04:34:53.176860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.762553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081112+0000","last_change":"2024-09-17T04:34:52.086233+0000","last_active":"2024-09-17T04:34:53.081112+0000","last_peered":"2024-09-17T04:34:53.081112+0000","last_clean":"2024-09-17T04:34:53.081112+0000","last_became_active":"2024-09-17T04:34:52.085876+0000","last_became_peered":"2024-09-17T04:34:52.085876+0000","last_unstale":"2024-09-17T04:34:53.081112+0000","last_undegraded":"2024-09-17T04:34:53.081112+0000","last_fullsized":"2024-09-17T04:34:53.081112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:44.061677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177349+0000","last_change":"2024-09-17T04:34:52.079305+0000","last_active":"2024-09-17T04:34:53.177349+0000","last_peered":"2024-09-17T04:34:53.177349+0000","last_clean":"2024-09-17T04:34:53.177349+0000","last_became_active":"2024-09-17T04:34:52.078984+0000","last_became_peered":"2024-09-17T04:34:52.078984+0000","last_unstale":"2024-09-17T04:34:53.177349+0000","last_undegraded":"2024-09-17T04:34:53.177349+0000","last_fullsized":"2024-09-17T04:34:53.177349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:15.927488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080877+0000","last_change":"2024-09-17T04:34:52.077495+0000","last_active":"2024-09-17T04:34:53.080877+0000","last_peered":"2024-09-17T04:34:53.080877+0000","last_clean":"2024-09-17T04:34:53.080877+0000","last_became_active":"2024-09-17T04:34:52.077167+0000","last_became_peered":"2024-09-17T04:34:52.077167+0000","last_unstale":"2024-09-17T04:34:53.080877+0000","last_undegraded":"2024-09-17T04:34:53.080877+0000","last_fullsized":"2024-09-17T04:34:53.080877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.411611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076209+0000","last_change":"2024-09-17T04:34:52.077389+0000","last_active":"2024-09-17T04:34:53.076209+0000","last_peered":"2024-09-17T04:34:53.076209+0000","last_clean":"2024-09-17T04:34:53.076209+0000","last_became_active":"2024-09-17T04:34:52.076993+0000","last_became_peered":"2024-09-17T04:34:52.076993+0000","last_unstale":"2024-09-17T04:34:53.076209+0000","last_undegraded":"2024-09-17T04:34:53.076209+0000","last_fullsized":"2024-09-17T04:34:53.076209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:18.540098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177228+0000","last_change":"2024-09-17T04:34:52.080545+0000","last_active":"2024-09-17T04:34:53.177228+0000","last_peered":"2024-09-17T04:34:53.177228+0000","last_clean":"2024-09-17T04:34:53.177228+0000","last_became_active":"2024-09-17T04:34:52.079930+0000","last_became_peered":"2024-09-17T04:34:52.079930+0000","last_unstale":"2024-09-17T04:34:53.177228+0000","last_undegraded":"2024-09-17T04:34:53.177228+0000","last_fullsized":"2024-09-17T04:34:53.177228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:50.491050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315714+0000","last_change":"2024-09-17T04:34:52.083598+0000","last_active":"2024-09-17T04:34:53.315714+0000","last_peered":"2024-09-17T04:34:53.315714+0000","last_clean":"2024-09-17T04:34:53.315714+0000","last_became_active":"2024-09-17T04:34:52.083225+0000","last_became_peered":"2024-09-17T04:34:52.083225+0000","last_unstale":"2024-09-17T04:34:53.315714+0000","last_undegraded":"2024-09-17T04:34:53.315714+0000","last_fullsized":"2024-09-17T04:34:53.315714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:22.713546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081731+0000","last_change":"2024-09-17T04:34:52.078977+0000","last_active":"2024-09-17T04:34:53.081731+0000","last_peered":"2024-09-17T04:34:53.081731+0000","last_clean":"2024-09-17T04:34:53.081731+0000","last_became_active":"2024-09-17T04:34:52.078636+0000","last_became_peered":"2024-09-17T04:34:52.078636+0000","last_unstale":"2024-09-17T04:34:53.081731+0000","last_undegraded":"2024-09-17T04:34:53.081731+0000","last_fullsized":"2024-09-17T04:34:53.081731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:30.144564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315840+0000","last_change":"2024-09-17T04:34:52.082113+0000","last_active":"2024-09-17T04:34:53.315840+0000","last_peered":"2024-09-17T04:34:53.315840+0000","last_clean":"2024-09-17T04:34:53.315840+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:34:53.315840+0000","last_undegraded":"2024-09-17T04:34:53.315840+0000","last_fullsized":"2024-09-17T04:34:53.315840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:52.744564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.078708+0000","last_change":"2024-09-17T04:34:52.083306+0000","last_active":"2024-09-17T04:34:53.078708+0000","last_peered":"2024-09-17T04:34:53.078708+0000","last_clean":"2024-09-17T04:34:53.078708+0000","last_became_active":"2024-09-17T04:34:52.082590+0000","last_became_peered":"2024-09-17T04:34:52.082590+0000","last_unstale":"2024-09-17T04:34:53.078708+0000","last_undegraded":"2024-09-17T04:34:53.078708+0000","last_fullsized":"2024-09-17T04:34:53.078708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:21.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.317989+0000","last_change":"2024-09-17T04:34:52.070155+0000","last_active":"2024-09-17T04:34:53.317989+0000","last_peered":"2024-09-17T04:34:53.317989+0000","last_clean":"2024-09-17T04:34:53.317989+0000","last_became_active":"2024-09-17T04:34:52.069498+0000","last_became_peered":"2024-09-17T04:34:52.069498+0000","last_unstale":"2024-09-17T04:34:53.317989+0000","last_undegraded":"2024-09-17T04:34:53.317989+0000","last_fullsized":"2024-09-17T04:34:53.317989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:24.539277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'5","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.117769+0000","last_change":"2024-09-17T04:34:51.074188+0000","last_active":"2024-09-17T04:35:03.117769+0000","last_peered":"2024-09-17T04:35:03.117769+0000","last_clean":"2024-09-17T04:35:03.117769+0000","last_became_active":"2024-09-17T04:34:51.073740+0000","last_became_peered":"2024-09-17T04:34:51.073740+0000","last_unstale":"2024-09-17T04:35:03.117769+0000","last_undegraded":"2024-09-17T04:35:03.117769+0000","last_fullsized":"2024-09-17T04:35:03.117769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:36.692687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315954+0000","last_change":"2024-09-17T04:34:52.081048+0000","last_active":"2024-09-17T04:34:53.315954+0000","last_peered":"2024-09-17T04:34:53.315954+0000","last_clean":"2024-09-17T04:34:53.315954+0000","last_became_active":"2024-09-17T04:34:52.080703+0000","last_became_peered":"2024-09-17T04:34:52.080703+0000","last_unstale":"2024-09-17T04:34:53.315954+0000","last_undegraded":"2024-09-17T04:34:53.315954+0000","last_fullsized":"2024-09-17T04:34:53.315954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:05.164849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.134261+0000","last_change":"2024-09-17T04:34:51.078602+0000","last_active":"2024-09-17T04:35:09.134261+0000","last_peered":"2024-09-17T04:35:09.134261+0000","last_clean":"2024-09-17T04:35:09.134261+0000","last_became_active":"2024-09-17T04:34:51.078221+0000","last_became_peered":"2024-09-17T04:34:51.078221+0000","last_unstale":"2024-09-17T04:35:09.134261+0000","last_undegraded":"2024-09-17T04:35:09.134261+0000","last_fullsized":"2024-09-17T04:35:09.134261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:59.716216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.133892+0000","last_change":"2024-09-17T04:34:51.077573+0000","last_active":"2024-09-17T04:35:09.133892+0000","last_peered":"2024-09-17T04:35:09.133892+0000","last_clean":"2024-09-17T04:35:09.133892+0000","last_became_active":"2024-09-17T04:34:51.077225+0000","last_became_peered":"2024-09-17T04:34:51.077225+0000","last_unstale":"2024-09-17T04:35:09.133892+0000","last_undegraded":"2024-09-17T04:35:09.133892+0000","last_fullsized":"2024-09-17T04:35:09.133892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:29.348927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176928+0000","last_change":"2024-09-17T04:34:52.074356+0000","last_active":"2024-09-17T04:34:53.176928+0000","last_peered":"2024-09-17T04:34:53.176928+0000","last_clean":"2024-09-17T04:34:53.176928+0000","last_became_active":"2024-09-17T04:34:52.072796+0000","last_became_peered":"2024-09-17T04:34:52.072796+0000","last_unstale":"2024-09-17T04:34:53.176928+0000","last_undegraded":"2024-09-17T04:34:53.176928+0000","last_fullsized":"2024-09-17T04:34:53.176928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:53.971839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081206+0000","last_change":"2024-09-17T04:34:51.074170+0000","last_active":"2024-09-17T04:34:53.081206+0000","last_peered":"2024-09-17T04:34:53.081206+0000","last_clean":"2024-09-17T04:34:53.081206+0000","last_became_active":"2024-09-17T04:34:51.073836+0000","last_became_peered":"2024-09-17T04:34:51.073836+0000","last_unstale":"2024-09-17T04:34:53.081206+0000","last_undegraded":"2024-09-17T04:34:53.081206+0000","last_fullsized":"2024-09-17T04:34:53.081206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:30.884002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075826+0000","last_change":"2024-09-17T04:34:52.078331+0000","last_active":"2024-09-17T04:34:53.075826+0000","last_peered":"2024-09-17T04:34:53.075826+0000","last_clean":"2024-09-17T04:34:53.075826+0000","last_became_active":"2024-09-17T04:34:52.078012+0000","last_became_peered":"2024-09-17T04:34:52.078012+0000","last_unstale":"2024-09-17T04:34:53.075826+0000","last_undegraded":"2024-09-17T04:34:53.075826+0000","last_fullsized":"2024-09-17T04:34:53.075826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:28.961571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.115412+0000","last_change":"2024-09-17T04:34:51.077676+0000","last_active":"2024-09-17T04:35:03.115412+0000","last_peered":"2024-09-17T04:35:03.115412+0000","last_clean":"2024-09-17T04:35:03.115412+0000","last_became_active":"2024-09-17T04:34:51.076291+0000","last_became_peered":"2024-09-17T04:34:51.076291+0000","last_unstale":"2024-09-17T04:35:03.115412+0000","last_undegraded":"2024-09-17T04:35:03.115412+0000","last_fullsized":"2024-09-17T04:35:03.115412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:42.622688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081329+0000","last_change":"2024-09-17T04:34:52.075624+0000","last_active":"2024-09-17T04:34:53.081329+0000","last_peered":"2024-09-17T04:34:53.081329+0000","last_clean":"2024-09-17T04:34:53.081329+0000","last_became_active":"2024-09-17T04:34:52.074943+0000","last_became_peered":"2024-09-17T04:34:52.074943+0000","last_unstale":"2024-09-17T04:34:53.081329+0000","last_undegraded":"2024-09-17T04:34:53.081329+0000","last_fullsized":"2024-09-17T04:34:53.081329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:56.749605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.117301+0000","last_change":"2024-09-17T04:34:51.077199+0000","last_active":"2024-09-17T04:35:03.117301+0000","last_peered":"2024-09-17T04:35:03.117301+0000","last_clean":"2024-09-17T04:35:03.117301+0000","last_became_active":"2024-09-17T04:34:51.076867+0000","last_became_peered":"2024-09-17T04:34:51.076867+0000","last_unstale":"2024-09-17T04:35:03.117301+0000","last_undegraded":"2024-09-17T04:35:03.117301+0000","last_fullsized":"2024-09-17T04:35:03.117301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:09.194133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315797+0000","last_change":"2024-09-17T04:34:52.083401+0000","last_active":"2024-09-17T04:34:53.315797+0000","last_peered":"2024-09-17T04:34:53.315797+0000","last_clean":"2024-09-17T04:34:53.315797+0000","last_became_active":"2024-09-17T04:34:52.083086+0000","last_became_peered":"2024-09-17T04:34:52.083086+0000","last_unstale":"2024-09-17T04:34:53.315797+0000","last_undegraded":"2024-09-17T04:34:53.315797+0000","last_fullsized":"2024-09-17T04:34:53.315797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.237945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.070202+0000","last_change":"2024-09-17T04:34:51.070235+0000","last_active":"2024-09-17T04:34:57.070202+0000","last_peered":"2024-09-17T04:34:57.070202+0000","last_clean":"2024-09-17T04:34:57.070202+0000","last_became_active":"2024-09-17T04:34:51.069278+0000","last_became_peered":"2024-09-17T04:34:51.069278+0000","last_unstale":"2024-09-17T04:34:57.070202+0000","last_undegraded":"2024-09-17T04:34:57.070202+0000","last_fullsized":"2024-09-17T04:34:57.070202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:55.959278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318073+0000","last_change":"2024-09-17T04:34:52.076233+0000","last_active":"2024-09-17T04:34:53.318073+0000","last_peered":"2024-09-17T04:34:53.318073+0000","last_clean":"2024-09-17T04:34:53.318073+0000","last_became_active":"2024-09-17T04:34:52.075682+0000","last_became_peered":"2024-09-17T04:34:52.075682+0000","last_unstale":"2024-09-17T04:34:53.318073+0000","last_undegraded":"2024-09-17T04:34:53.318073+0000","last_fullsized":"2024-09-17T04:34:53.318073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:22.047574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.114213+0000","last_change":"2024-09-17T04:34:51.076416+0000","last_active":"2024-09-17T04:35:03.114213+0000","last_peered":"2024-09-17T04:35:03.114213+0000","last_clean":"2024-09-17T04:35:03.114213+0000","last_became_active":"2024-09-17T04:34:51.076051+0000","last_became_peered":"2024-09-17T04:34:51.076051+0000","last_unstale":"2024-09-17T04:35:03.114213+0000","last_undegraded":"2024-09-17T04:35:03.114213+0000","last_fullsized":"2024-09-17T04:35:03.114213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:52.255204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079732+0000","last_change":"2024-09-17T04:34:52.086230+0000","last_active":"2024-09-17T04:34:53.079732+0000","last_peered":"2024-09-17T04:34:53.079732+0000","last_clean":"2024-09-17T04:34:53.079732+0000","last_became_active":"2024-09-17T04:34:52.085910+0000","last_became_peered":"2024-09-17T04:34:52.085910+0000","last_unstale":"2024-09-17T04:34:53.079732+0000","last_undegraded":"2024-09-17T04:34:53.079732+0000","last_fullsized":"2024-09-17T04:34:53.079732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:36.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.133250+0000","last_change":"2024-09-17T04:34:51.075224+0000","last_active":"2024-09-17T04:35:09.133250+0000","last_peered":"2024-09-17T04:35:09.133250+0000","last_clean":"2024-09-17T04:35:09.133250+0000","last_became_active":"2024-09-17T04:34:51.074912+0000","last_became_peered":"2024-09-17T04:34:51.074912+0000","last_unstale":"2024-09-17T04:35:09.133250+0000","last_undegraded":"2024-09-17T04:35:09.133250+0000","last_fullsized":"2024-09-17T04:35:09.133250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:33.811243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315617+0000","last_change":"2024-09-17T04:34:52.085906+0000","last_active":"2024-09-17T04:34:53.315617+0000","last_peered":"2024-09-17T04:34:53.315617+0000","last_clean":"2024-09-17T04:34:53.315617+0000","last_became_active":"2024-09-17T04:34:52.085538+0000","last_became_peered":"2024-09-17T04:34:52.085538+0000","last_unstale":"2024-09-17T04:34:53.315617+0000","last_undegraded":"2024-09-17T04:34:53.315617+0000","last_fullsized":"2024-09-17T04:34:53.315617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:21.997395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.115092+0000","last_change":"2024-09-17T04:34:51.074253+0000","last_active":"2024-09-17T04:35:03.115092+0000","last_peered":"2024-09-17T04:35:03.115092+0000","last_clean":"2024-09-17T04:35:03.115092+0000","last_became_active":"2024-09-17T04:34:51.073812+0000","last_became_peered":"2024-09-17T04:34:51.073812+0000","last_unstale":"2024-09-17T04:35:03.115092+0000","last_undegraded":"2024-09-17T04:35:03.115092+0000","last_fullsized":"2024-09-17T04:35:03.115092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:38.971561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081022+0000","last_change":"2024-09-17T04:34:52.082137+0000","last_active":"2024-09-17T04:34:53.081022+0000","last_peered":"2024-09-17T04:34:53.081022+0000","last_clean":"2024-09-17T04:34:53.081022+0000","last_became_active":"2024-09-17T04:34:52.081775+0000","last_became_peered":"2024-09-17T04:34:52.081775+0000","last_unstale":"2024-09-17T04:34:53.081022+0000","last_undegraded":"2024-09-17T04:34:53.081022+0000","last_fullsized":"2024-09-17T04:34:53.081022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:57.911822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.135451+0000","last_change":"2024-09-17T04:34:51.077157+0000","last_active":"2024-09-17T04:35:09.135451+0000","last_peered":"2024-09-17T04:35:09.135451+0000","last_clean":"2024-09-17T04:35:09.135451+0000","last_became_active":"2024-09-17T04:34:51.076797+0000","last_became_peered":"2024-09-17T04:34:51.076797+0000","last_unstale":"2024-09-17T04:35:09.135451+0000","last_undegraded":"2024-09-17T04:35:09.135451+0000","last_fullsized":"2024-09-17T04:35:09.135451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:20.118978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079355+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:34:53.079355+0000","last_peered":"2024-09-17T04:34:53.079355+0000","last_clean":"2024-09-17T04:34:53.079355+0000","last_became_active":"2024-09-17T04:34:52.082118+0000","last_became_peered":"2024-09-17T04:34:52.082118+0000","last_unstale":"2024-09-17T04:34:53.079355+0000","last_undegraded":"2024-09-17T04:34:53.079355+0000","last_fullsized":"2024-09-17T04:34:53.079355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:44.752945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'15","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.135849+0000","last_change":"2024-09-17T04:34:51.071083+0000","last_active":"2024-09-17T04:35:09.135849+0000","last_peered":"2024-09-17T04:35:09.135849+0000","last_clean":"2024-09-17T04:35:09.135849+0000","last_became_active":"2024-09-17T04:34:51.070733+0000","last_became_peered":"2024-09-17T04:34:51.070733+0000","last_unstale":"2024-09-17T04:35:09.135849+0000","last_undegraded":"2024-09-17T04:35:09.135849+0000","last_fullsized":"2024-09-17T04:35:09.135849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:36.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079638+0000","last_change":"2024-09-17T04:34:52.080277+0000","last_active":"2024-09-17T04:34:53.079638+0000","last_peered":"2024-09-17T04:34:53.079638+0000","last_clean":"2024-09-17T04:34:53.079638+0000","last_became_active":"2024-09-17T04:34:52.079969+0000","last_became_peered":"2024-09-17T04:34:52.079969+0000","last_unstale":"2024-09-17T04:34:53.079638+0000","last_undegraded":"2024-09-17T04:34:53.079638+0000","last_fullsized":"2024-09-17T04:34:53.079638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:10.360905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.064001+0000","last_change":"2024-09-17T04:34:51.074800+0000","last_active":"2024-09-17T04:34:57.064001+0000","last_peered":"2024-09-17T04:34:57.064001+0000","last_clean":"2024-09-17T04:34:57.064001+0000","last_became_active":"2024-09-17T04:34:51.073287+0000","last_became_peered":"2024-09-17T04:34:51.073287+0000","last_unstale":"2024-09-17T04:34:57.064001+0000","last_undegraded":"2024-09-17T04:34:57.064001+0000","last_fullsized":"2024-09-17T04:34:57.064001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:19.933857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079619+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:34:53.079619+0000","last_peered":"2024-09-17T04:34:53.079619+0000","last_clean":"2024-09-17T04:34:53.079619+0000","last_became_active":"2024-09-17T04:34:52.082607+0000","last_became_peered":"2024-09-17T04:34:52.082607+0000","last_unstale":"2024-09-17T04:34:53.079619+0000","last_undegraded":"2024-09-17T04:34:53.079619+0000","last_fullsized":"2024-09-17T04:34:53.079619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:08.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.064837+0000","last_change":"2024-09-17T04:34:51.077171+0000","last_active":"2024-09-17T04:34:57.064837+0000","last_peered":"2024-09-17T04:34:57.064837+0000","last_clean":"2024-09-17T04:34:57.064837+0000","last_became_active":"2024-09-17T04:34:51.076780+0000","last_became_peered":"2024-09-17T04:34:51.076780+0000","last_unstale":"2024-09-17T04:34:57.064837+0000","last_undegraded":"2024-09-17T04:34:57.064837+0000","last_fullsized":"2024-09-17T04:34:57.064837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:40.031852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079942+0000","last_change":"2024-09-17T04:34:52.080032+0000","last_active":"2024-09-17T04:34:53.079942+0000","last_peered":"2024-09-17T04:34:53.079942+0000","last_clean":"2024-09-17T04:34:53.079942+0000","last_became_active":"2024-09-17T04:34:52.079536+0000","last_became_peered":"2024-09-17T04:34:52.079536+0000","last_unstale":"2024-09-17T04:34:53.079942+0000","last_undegraded":"2024-09-17T04:34:53.079942+0000","last_fullsized":"2024-09-17T04:34:53.079942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:55.220027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:54.608800+0000","last_change":"2024-09-17T04:34:51.071053+0000","last_active":"2024-09-17T04:34:54.608800+0000","last_peered":"2024-09-17T04:34:54.608800+0000","last_clean":"2024-09-17T04:34:54.608800+0000","last_became_active":"2024-09-17T04:34:51.070673+0000","last_became_peered":"2024-09-17T04:34:51.070673+0000","last_unstale":"2024-09-17T04:34:54.608800+0000","last_undegraded":"2024-09-17T04:34:54.608800+0000","last_fullsized":"2024-09-17T04:34:54.608800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:31.660200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081894+0000","last_change":"2024-09-17T04:34:52.077963+0000","last_active":"2024-09-17T04:34:53.081894+0000","last_peered":"2024-09-17T04:34:53.081894+0000","last_clean":"2024-09-17T04:34:53.081894+0000","last_became_active":"2024-09-17T04:34:52.077499+0000","last_became_peered":"2024-09-17T04:34:52.077499+0000","last_unstale":"2024-09-17T04:34:53.081894+0000","last_undegraded":"2024-09-17T04:34:53.081894+0000","last_fullsized":"2024-09-17T04:34:53.081894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:25.309696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.134094+0000","last_change":"2024-09-17T04:34:51.070532+0000","last_active":"2024-09-17T04:35:09.134094+0000","last_peered":"2024-09-17T04:35:09.134094+0000","last_clean":"2024-09-17T04:35:09.134094+0000","last_became_active":"2024-09-17T04:34:51.070179+0000","last_became_peered":"2024-09-17T04:34:51.070179+0000","last_unstale":"2024-09-17T04:35:09.134094+0000","last_undegraded":"2024-09-17T04:35:09.134094+0000","last_fullsized":"2024-09-17T04:35:09.134094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:52.027096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079935+0000","last_change":"2024-09-17T04:34:52.083159+0000","last_active":"2024-09-17T04:34:53.079935+0000","last_peered":"2024-09-17T04:34:53.079935+0000","last_clean":"2024-09-17T04:34:53.079935+0000","last_became_active":"2024-09-17T04:34:52.082847+0000","last_became_peered":"2024-09-17T04:34:52.082847+0000","last_unstale":"2024-09-17T04:34:53.079935+0000","last_undegraded":"2024-09-17T04:34:53.079935+0000","last_fullsized":"2024-09-17T04:34:53.079935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:25.210506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080417+0000","last_change":"2024-09-17T04:34:41.975789+0000","last_active":"2024-09-17T04:34:53.080417+0000","last_peered":"2024-09-17T04:34:53.080417+0000","last_clean":"2024-09-17T04:34:53.080417+0000","last_became_active":"2024-09-17T04:34:41.974664+0000","last_became_peered":"2024-09-17T04:34:41.974664+0000","last_unstale":"2024-09-17T04:34:53.080417+0000","last_undegraded":"2024-09-17T04:34:53.080417+0000","last_fullsized":"2024-09-17T04:34:53.080417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_clean_scrub_stamp":"2024-09-17T04:34:39.702713+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:30.302931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.114706+0000","last_change":"2024-09-17T04:34:51.068782+0000","last_active":"2024-09-17T04:35:03.114706+0000","last_peered":"2024-09-17T04:35:03.114706+0000","last_clean":"2024-09-17T04:35:03.114706+0000","last_became_active":"2024-09-17T04:34:51.068375+0000","last_became_peered":"2024-09-17T04:34:51.068375+0000","last_unstale":"2024-09-17T04:35:03.114706+0000","last_undegraded":"2024-09-17T04:35:03.114706+0000","last_fullsized":"2024-09-17T04:35:03.114706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:25.307166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177343+0000","last_change":"2024-09-17T04:34:52.086768+0000","last_active":"2024-09-17T04:34:53.177343+0000","last_peered":"2024-09-17T04:34:53.177343+0000","last_clean":"2024-09-17T04:34:53.177343+0000","last_became_active":"2024-09-17T04:34:52.086415+0000","last_became_peered":"2024-09-17T04:34:52.086415+0000","last_unstale":"2024-09-17T04:34:53.177343+0000","last_undegraded":"2024-09-17T04:34:53.177343+0000","last_fullsized":"2024-09-17T04:34:53.177343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:45.527873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.133868+0000","last_change":"2024-09-17T04:34:51.075655+0000","last_active":"2024-09-17T04:35:09.133868+0000","last_peered":"2024-09-17T04:35:09.133868+0000","last_clean":"2024-09-17T04:35:09.133868+0000","last_became_active":"2024-09-17T04:34:51.075313+0000","last_became_peered":"2024-09-17T04:34:51.075313+0000","last_unstale":"2024-09-17T04:35:09.133868+0000","last_undegraded":"2024-09-17T04:35:09.133868+0000","last_fullsized":"2024-09-17T04:35:09.133868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:47.853850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315306+0000","last_change":"2024-09-17T04:34:52.080065+0000","last_active":"2024-09-17T04:34:53.315306+0000","last_peered":"2024-09-17T04:34:53.315306+0000","last_clean":"2024-09-17T04:34:53.315306+0000","last_became_active":"2024-09-17T04:34:52.079672+0000","last_became_peered":"2024-09-17T04:34:52.079672+0000","last_unstale":"2024-09-17T04:34:53.315306+0000","last_undegraded":"2024-09-17T04:34:53.315306+0000","last_fullsized":"2024-09-17T04:34:53.315306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:52.040153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.134345+0000","last_change":"2024-09-17T04:34:51.075960+0000","last_active":"2024-09-17T04:35:09.134345+0000","last_peered":"2024-09-17T04:35:09.134345+0000","last_clean":"2024-09-17T04:35:09.134345+0000","last_became_active":"2024-09-17T04:34:51.075561+0000","last_became_peered":"2024-09-17T04:34:51.075561+0000","last_unstale":"2024-09-17T04:35:09.134345+0000","last_undegraded":"2024-09-17T04:35:09.134345+0000","last_fullsized":"2024-09-17T04:35:09.134345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:44.834618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075859+0000","last_change":"2024-09-17T04:34:52.070068+0000","last_active":"2024-09-17T04:34:53.075859+0000","last_peered":"2024-09-17T04:34:53.075859+0000","last_clean":"2024-09-17T04:34:53.075859+0000","last_became_active":"2024-09-17T04:34:52.069669+0000","last_became_peered":"2024-09-17T04:34:52.069669+0000","last_unstale":"2024-09-17T04:34:53.075859+0000","last_undegraded":"2024-09-17T04:34:53.075859+0000","last_fullsized":"2024-09-17T04:34:53.075859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:39.617045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081881+0000","last_change":"2024-09-17T04:34:51.070187+0000","last_active":"2024-09-17T04:34:53.081881+0000","last_peered":"2024-09-17T04:34:53.081881+0000","last_clean":"2024-09-17T04:34:53.081881+0000","last_became_active":"2024-09-17T04:34:51.069714+0000","last_became_peered":"2024-09-17T04:34:51.069714+0000","last_unstale":"2024-09-17T04:34:53.081881+0000","last_undegraded":"2024-09-17T04:34:53.081881+0000","last_fullsized":"2024-09-17T04:34:53.081881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:28.082690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318145+0000","last_change":"2024-09-17T04:34:52.069653+0000","last_active":"2024-09-17T04:34:53.318145+0000","last_peered":"2024-09-17T04:34:53.318145+0000","last_clean":"2024-09-17T04:34:53.318145+0000","last_became_active":"2024-09-17T04:34:52.069282+0000","last_became_peered":"2024-09-17T04:34:52.069282+0000","last_unstale":"2024-09-17T04:34:53.318145+0000","last_undegraded":"2024-09-17T04:34:53.318145+0000","last_fullsized":"2024-09-17T04:34:53.318145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:40.828725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076208+0000","last_change":"2024-09-17T04:34:51.070676+0000","last_active":"2024-09-17T04:34:53.076208+0000","last_peered":"2024-09-17T04:34:53.076208+0000","last_clean":"2024-09-17T04:34:53.076208+0000","last_became_active":"2024-09-17T04:34:51.069006+0000","last_became_peered":"2024-09-17T04:34:51.069006+0000","last_unstale":"2024-09-17T04:34:53.076208+0000","last_undegraded":"2024-09-17T04:34:53.076208+0000","last_fullsized":"2024-09-17T04:34:53.076208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:45.452865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081804+0000","last_change":"2024-09-17T04:34:52.087131+0000","last_active":"2024-09-17T04:34:53.081804+0000","last_peered":"2024-09-17T04:34:53.081804+0000","last_clean":"2024-09-17T04:34:53.081804+0000","last_became_active":"2024-09-17T04:34:52.086782+0000","last_became_peered":"2024-09-17T04:34:52.086782+0000","last_unstale":"2024-09-17T04:34:53.081804+0000","last_undegraded":"2024-09-17T04:34:53.081804+0000","last_fullsized":"2024-09-17T04:34:53.081804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:53.987579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080543+0000","last_change":"2024-09-17T04:34:51.068708+0000","last_active":"2024-09-17T04:34:53.080543+0000","last_peered":"2024-09-17T04:34:53.080543+0000","last_clean":"2024-09-17T04:34:53.080543+0000","last_became_active":"2024-09-17T04:34:51.068354+0000","last_became_peered":"2024-09-17T04:34:51.068354+0000","last_unstale":"2024-09-17T04:34:53.080543+0000","last_undegraded":"2024-09-17T04:34:53.080543+0000","last_fullsized":"2024-09-17T04:34:53.080543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:04.219898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076122+0000","last_change":"2024-09-17T04:34:52.071586+0000","last_active":"2024-09-17T04:34:53.076122+0000","last_peered":"2024-09-17T04:34:53.076122+0000","last_clean":"2024-09-17T04:34:53.076122+0000","last_became_active":"2024-09-17T04:34:52.071246+0000","last_became_peered":"2024-09-17T04:34:52.071246+0000","last_unstale":"2024-09-17T04:34:53.076122+0000","last_undegraded":"2024-09-17T04:34:53.076122+0000","last_fullsized":"2024-09-17T04:34:53.076122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:03.620107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.133594+0000","last_change":"2024-09-17T04:34:51.078947+0000","last_active":"2024-09-17T04:35:09.133594+0000","last_peered":"2024-09-17T04:35:09.133594+0000","last_clean":"2024-09-17T04:35:09.133594+0000","last_became_active":"2024-09-17T04:34:51.078557+0000","last_became_peered":"2024-09-17T04:34:51.078557+0000","last_unstale":"2024-09-17T04:35:09.133594+0000","last_undegraded":"2024-09-17T04:35:09.133594+0000","last_fullsized":"2024-09-17T04:35:09.133594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:51.413772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177384+0000","last_change":"2024-09-17T04:34:52.086372+0000","last_active":"2024-09-17T04:34:53.177384+0000","last_peered":"2024-09-17T04:34:53.177384+0000","last_clean":"2024-09-17T04:34:53.177384+0000","last_became_active":"2024-09-17T04:34:52.086018+0000","last_became_peered":"2024-09-17T04:34:52.086018+0000","last_unstale":"2024-09-17T04:34:53.177384+0000","last_undegraded":"2024-09-17T04:34:53.177384+0000","last_fullsized":"2024-09-17T04:34:53.177384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:10.818503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.115014+0000","last_change":"2024-09-17T04:34:51.076427+0000","last_active":"2024-09-17T04:35:03.115014+0000","last_peered":"2024-09-17T04:35:03.115014+0000","last_clean":"2024-09-17T04:35:03.115014+0000","last_became_active":"2024-09-17T04:34:51.075881+0000","last_became_peered":"2024-09-17T04:34:51.075881+0000","last_unstale":"2024-09-17T04:35:03.115014+0000","last_undegraded":"2024-09-17T04:35:03.115014+0000","last_fullsized":"2024-09-17T04:35:03.115014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:40.903989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315468+0000","last_change":"2024-09-17T04:34:52.076358+0000","last_active":"2024-09-17T04:34:53.315468+0000","last_peered":"2024-09-17T04:34:53.315468+0000","last_clean":"2024-09-17T04:34:53.315468+0000","last_became_active":"2024-09-17T04:34:52.076035+0000","last_became_peered":"2024-09-17T04:34:52.076035+0000","last_unstale":"2024-09-17T04:34:53.315468+0000","last_undegraded":"2024-09-17T04:34:53.315468+0000","last_fullsized":"2024-09-17T04:34:53.315468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:30.660617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.114379+0000","last_change":"2024-09-17T04:34:51.072737+0000","last_active":"2024-09-17T04:35:03.114379+0000","last_peered":"2024-09-17T04:35:03.114379+0000","last_clean":"2024-09-17T04:35:03.114379+0000","last_became_active":"2024-09-17T04:34:51.072378+0000","last_became_peered":"2024-09-17T04:34:51.072378+0000","last_unstale":"2024-09-17T04:35:03.114379+0000","last_undegraded":"2024-09-17T04:35:03.114379+0000","last_fullsized":"2024-09-17T04:35:03.114379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:27.364636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318181+0000","last_change":"2024-09-17T04:34:52.068446+0000","last_active":"2024-09-17T04:34:53.318181+0000","last_peered":"2024-09-17T04:34:53.318181+0000","last_clean":"2024-09-17T04:34:53.318181+0000","last_became_active":"2024-09-17T04:34:52.068047+0000","last_became_peered":"2024-09-17T04:34:52.068047+0000","last_unstale":"2024-09-17T04:34:53.318181+0000","last_undegraded":"2024-09-17T04:34:53.318181+0000","last_fullsized":"2024-09-17T04:34:53.318181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:26.994189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.115076+0000","last_change":"2024-09-17T04:34:51.069539+0000","last_active":"2024-09-17T04:35:03.115076+0000","last_peered":"2024-09-17T04:35:03.115076+0000","last_clean":"2024-09-17T04:35:03.115076+0000","last_became_active":"2024-09-17T04:34:51.067438+0000","last_became_peered":"2024-09-17T04:34:51.067438+0000","last_unstale":"2024-09-17T04:35:03.115076+0000","last_undegraded":"2024-09-17T04:35:03.115076+0000","last_fullsized":"2024-09-17T04:35:03.115076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:13.078391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177144+0000","last_change":"2024-09-17T04:34:52.078035+0000","last_active":"2024-09-17T04:34:53.177144+0000","last_peered":"2024-09-17T04:34:53.177144+0000","last_clean":"2024-09-17T04:34:53.177144+0000","last_became_active":"2024-09-17T04:34:52.077708+0000","last_became_peered":"2024-09-17T04:34:52.077708+0000","last_unstale":"2024-09-17T04:34:53.177144+0000","last_undegraded":"2024-09-17T04:34:53.177144+0000","last_fullsized":"2024-09-17T04:34:53.177144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:00.313209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:54.608737+0000","last_change":"2024-09-17T04:34:51.074749+0000","last_active":"2024-09-17T04:34:54.608737+0000","last_peered":"2024-09-17T04:34:54.608737+0000","last_clean":"2024-09-17T04:34:54.608737+0000","last_became_active":"2024-09-17T04:34:51.074393+0000","last_became_peered":"2024-09-17T04:34:51.074393+0000","last_unstale":"2024-09-17T04:34:54.608737+0000","last_undegraded":"2024-09-17T04:34:54.608737+0000","last_fullsized":"2024-09-17T04:34:54.608737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:39.558815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177339+0000","last_change":"2024-09-17T04:34:52.075585+0000","last_active":"2024-09-17T04:34:53.177339+0000","last_peered":"2024-09-17T04:34:53.177339+0000","last_clean":"2024-09-17T04:34:53.177339+0000","last_became_active":"2024-09-17T04:34:52.075257+0000","last_became_peered":"2024-09-17T04:34:52.075257+0000","last_unstale":"2024-09-17T04:34:53.177339+0000","last_undegraded":"2024-09-17T04:34:53.177339+0000","last_fullsized":"2024-09-17T04:34:53.177339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:38.029256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.114728+0000","last_change":"2024-09-17T04:34:51.071324+0000","last_active":"2024-09-17T04:35:03.114728+0000","last_peered":"2024-09-17T04:35:03.114728+0000","last_clean":"2024-09-17T04:35:03.114728+0000","last_became_active":"2024-09-17T04:34:51.070944+0000","last_became_peered":"2024-09-17T04:34:51.070944+0000","last_unstale":"2024-09-17T04:35:03.114728+0000","last_undegraded":"2024-09-17T04:35:03.114728+0000","last_fullsized":"2024-09-17T04:35:03.114728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:13.931324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079005+0000","last_change":"2024-09-17T04:34:52.081178+0000","last_active":"2024-09-17T04:34:53.079005+0000","last_peered":"2024-09-17T04:34:53.079005+0000","last_clean":"2024-09-17T04:34:53.079005+0000","last_became_active":"2024-09-17T04:34:52.080855+0000","last_became_peered":"2024-09-17T04:34:52.080855+0000","last_unstale":"2024-09-17T04:34:53.079005+0000","last_undegraded":"2024-09-17T04:34:53.079005+0000","last_fullsized":"2024-09-17T04:34:53.079005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:49.091080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081719+0000","last_change":"2024-09-17T04:34:52.066633+0000","last_active":"2024-09-17T04:34:53.081719+0000","last_peered":"2024-09-17T04:34:53.081719+0000","last_clean":"2024-09-17T04:34:53.081719+0000","last_became_active":"2024-09-17T04:34:52.066263+0000","last_became_peered":"2024-09-17T04:34:52.066263+0000","last_unstale":"2024-09-17T04:34:53.081719+0000","last_undegraded":"2024-09-17T04:34:53.081719+0000","last_fullsized":"2024-09-17T04:34:53.081719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:13.396220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.068696+0000","last_change":"2024-09-17T04:34:51.067927+0000","last_active":"2024-09-17T04:34:57.068696+0000","last_peered":"2024-09-17T04:34:57.068696+0000","last_clean":"2024-09-17T04:34:57.068696+0000","last_became_active":"2024-09-17T04:34:51.067555+0000","last_became_peered":"2024-09-17T04:34:51.067555+0000","last_unstale":"2024-09-17T04:34:57.068696+0000","last_undegraded":"2024-09-17T04:34:57.068696+0000","last_fullsized":"2024-09-17T04:34:57.068696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:33.815585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081560+0000","last_change":"2024-09-17T04:34:52.074529+0000","last_active":"2024-09-17T04:34:53.081560+0000","last_peered":"2024-09-17T04:34:53.081560+0000","last_clean":"2024-09-17T04:34:53.081560+0000","last_became_active":"2024-09-17T04:34:52.074149+0000","last_became_peered":"2024-09-17T04:34:52.074149+0000","last_unstale":"2024-09-17T04:34:53.081560+0000","last_undegraded":"2024-09-17T04:34:53.081560+0000","last_fullsized":"2024-09-17T04:34:53.081560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:31.679908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.131973+0000","last_change":"2024-09-17T04:34:51.078231+0000","last_active":"2024-09-17T04:35:09.131973+0000","last_peered":"2024-09-17T04:35:09.131973+0000","last_clean":"2024-09-17T04:35:09.131973+0000","last_became_active":"2024-09-17T04:34:51.077872+0000","last_became_peered":"2024-09-17T04:34:51.077872+0000","last_unstale":"2024-09-17T04:35:09.131973+0000","last_undegraded":"2024-09-17T04:35:09.131973+0000","last_fullsized":"2024-09-17T04:35:09.131973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:38.304333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315510+0000","last_change":"2024-09-17T04:34:52.084955+0000","last_active":"2024-09-17T04:34:53.315510+0000","last_peered":"2024-09-17T04:34:53.315510+0000","last_clean":"2024-09-17T04:34:53.315510+0000","last_became_active":"2024-09-17T04:34:52.084559+0000","last_became_peered":"2024-09-17T04:34:52.084559+0000","last_unstale":"2024-09-17T04:34:53.315510+0000","last_undegraded":"2024-09-17T04:34:53.315510+0000","last_fullsized":"2024-09-17T04:34:53.315510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:28.901357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.063980+0000","last_change":"2024-09-17T04:34:51.073959+0000","last_active":"2024-09-17T04:34:57.063980+0000","last_peered":"2024-09-17T04:34:57.063980+0000","last_clean":"2024-09-17T04:34:57.063980+0000","last_became_active":"2024-09-17T04:34:51.073496+0000","last_became_peered":"2024-09-17T04:34:51.073496+0000","last_unstale":"2024-09-17T04:34:57.063980+0000","last_undegraded":"2024-09-17T04:34:57.063980+0000","last_fullsized":"2024-09-17T04:34:57.063980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:23.001571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177328+0000","last_change":"2024-09-17T04:34:52.081971+0000","last_active":"2024-09-17T04:34:53.177328+0000","last_peered":"2024-09-17T04:34:53.177328+0000","last_clean":"2024-09-17T04:34:53.177328+0000","last_became_active":"2024-09-17T04:34:52.081259+0000","last_became_peered":"2024-09-17T04:34:52.081259+0000","last_unstale":"2024-09-17T04:34:53.177328+0000","last_undegraded":"2024-09-17T04:34:53.177328+0000","last_fullsized":"2024-09-17T04:34:53.177328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:43.915741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'9","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.134730+0000","last_change":"2024-09-17T04:34:51.070142+0000","last_active":"2024-09-17T04:35:09.134730+0000","last_peered":"2024-09-17T04:35:09.134730+0000","last_clean":"2024-09-17T04:35:09.134730+0000","last_became_active":"2024-09-17T04:34:51.069777+0000","last_became_peered":"2024-09-17T04:34:51.069777+0000","last_unstale":"2024-09-17T04:35:09.134730+0000","last_undegraded":"2024-09-17T04:35:09.134730+0000","last_fullsized":"2024-09-17T04:35:09.134730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:51.718064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5222,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":10444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476747,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":831488,"data_stored":668230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476747,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":78836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476747,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":77924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476747,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":77260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35580,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336260,"statfs":{"total":96636764160,"available":96600330240,"internally_reserved":0,"allocated":241664,"data_stored":78870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":237568,"data_stored":77364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":77490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":827392,"data_stored":667574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:35:18.797 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:35:18.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.949+0000 7f95c03c3640 1 -- 172.21.15.43:0/1580276831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95b81539f0 msgr2=0x7f95b80c6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:18.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.949+0000 7f95c03c3640 1 --2- 172.21.15.43:0/1580276831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95b81539f0 0x7f95b80c6e50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f95b80cbab0 tx=0x7f95ac02a5f0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.949+0000 7f95c03c3640 1 -- 172.21.15.43:0/1580276831 shutdown_connections 2024-09-17T04:35:18.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.949+0000 7f95c03c3640 1 --2- 172.21.15.43:0/1580276831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95b81539f0 0x7f95b80c6e50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.949+0000 7f95c03c3640 1 --2- 172.21.15.43:0/1580276831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95b80c7570 0x7f95b80c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.949+0000 7f95c03c3640 1 --2- 172.21.15.43:0/1580276831 >> v2:172.21.15.62:3300/0 conn(0x7f95b81535e0 0x7f95b80c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.949+0000 7f95c03c3640 1 -- 172.21.15.43:0/1580276831 >> 172.21.15.43:0/1580276831 conn(0x7f95b80738e0 msgr2=0x7f95b8073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:18.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.949+0000 7f95c03c3640 1 -- 172.21.15.43:0/1580276831 shutdown_connections 2024-09-17T04:35:18.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.949+0000 7f95c03c3640 1 -- 172.21.15.43:0/1580276831 wait complete. 2024-09-17T04:35:18.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.951+0000 7f95c03c3640 1 Processor -- start 2024-09-17T04:35:18.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.951+0000 7f95c03c3640 1 -- start start 2024-09-17T04:35:18.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.952+0000 7f95c03c3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95b80c7570 0x7f95b80c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:18.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95c03c3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95b81535e0 0x7f95b81f1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:18.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95c03c3640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95b81539f0 0x7f95b81e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:18.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95c03c3640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f95b8159650 con 0x7f95b81535e0 2024-09-17T04:35:18.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95c03c3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f95b80c6110 con 0x7f95b80c7570 2024-09-17T04:35:18.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95c03c3640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f95b80c5420 con 0x7f95b81539f0 2024-09-17T04:35:18.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95bd95e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95b81535e0 0x7f95b81f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:18.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95bd95e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95b81535e0 0x7f95b81f1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37348/0 (socket says 172.21.15.43:37348) 2024-09-17T04:35:18.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95bd95e640 1 -- 172.21.15.43:0/2624722993 learned_addr learned my addr 172.21.15.43:0/2624722993 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:18.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95be15f640 1 --2- 172.21.15.43:0/2624722993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95b80c7570 0x7f95b80c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:18.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95be960640 1 --2- 172.21.15.43:0/2624722993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95b81539f0 0x7f95b81e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:18.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95bd95e640 1 -- 172.21.15.43:0/2624722993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95b81539f0 msgr2=0x7f95b81e50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:18.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95bd95e640 1 --2- 172.21.15.43:0/2624722993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95b81539f0 0x7f95b81e50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95bd95e640 1 -- 172.21.15.43:0/2624722993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95b80c7570 msgr2=0x7f95b80c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:18.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95bd95e640 1 --2- 172.21.15.43:0/2624722993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95b80c7570 0x7f95b80c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:18.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95bd95e640 1 -- 172.21.15.43:0/2624722993 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b81f1b90 con 0x7f95b81535e0 2024-09-17T04:35:18.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95bd95e640 1 --2- 172.21.15.43:0/2624722993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95b81535e0 0x7f95b81f1650 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95ac000c00 tx=0x7f95ac003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:18.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95b6ffd640 1 -- 172.21.15.43:0/2624722993 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac03e030 con 0x7f95b81535e0 2024-09-17T04:35:18.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95b6ffd640 1 -- 172.21.15.43:0/2624722993 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95ac003e00 con 0x7f95b81535e0 2024-09-17T04:35:18.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.953+0000 7f95c03c3640 1 -- 172.21.15.43:0/2624722993 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b806fe60 con 0x7f95b81535e0 2024-09-17T04:35:18.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.954+0000 7f95b6ffd640 1 -- 172.21.15.43:0/2624722993 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac035040 con 0x7f95b81535e0 2024-09-17T04:35:18.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.954+0000 7f95c03c3640 1 -- 172.21.15.43:0/2624722993 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b80c3190 con 0x7f95b81535e0 2024-09-17T04:35:18.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.954+0000 7f95c03c3640 1 -- 172.21.15.43:0/2624722993 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b80b3ed0 con 0x7f95b81535e0 2024-09-17T04:35:18.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.955+0000 7f95b6ffd640 1 -- 172.21.15.43:0/2624722993 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f95ac041030 con 0x7f95b81535e0 2024-09-17T04:35:18.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.956+0000 7f95b6ffd640 1 --2- 172.21.15.43:0/2624722993 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f95a4078bc0 0x7f95a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:18.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.956+0000 7f95b6ffd640 1 -- 172.21.15.43:0/2624722993 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f95ac0bb350 con 0x7f95b81535e0 2024-09-17T04:35:18.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.956+0000 7f95be15f640 1 --2- 172.21.15.43:0/2624722993 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f95a4078bc0 0x7f95a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:18.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.956+0000 7f95be15f640 1 --2- 172.21.15.43:0/2624722993 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f95a4078bc0 0x7f95a407b0d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f95a8005fd0 tx=0x7f95a80095e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:18.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:18.960+0000 7f95b6ffd640 1 -- 172.21.15.43:0/2624722993 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f95ac0831e0 con 0x7f95b81535e0 2024-09-17T04:35:19.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.142+0000 7f95c03c3640 1 -- 172.21.15.43:0/2624722993 --> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f95b81e55e0 con 0x7f95a4078bc0 2024-09-17T04:35:19.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.146+0000 7f95b6ffd640 1 -- 172.21.15.43:0/2624722993 <== mgr.4100 v2:172.21.15.62:6800/1186143747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251880 (secure 0 0 0) 0x7f95b81e55e0 con 0x7f95a4078bc0 2024-09-17T04:35:19.149 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:35:19.150 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-17T04:35:19.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.149+0000 7f95c03c3640 1 -- 172.21.15.43:0/2624722993 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f95a4078bc0 msgr2=0x7f95a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:19.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.149+0000 7f95c03c3640 1 --2- 172.21.15.43:0/2624722993 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f95a4078bc0 0x7f95a407b0d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f95a8005fd0 tx=0x7f95a80095e0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.149+0000 7f95c03c3640 1 -- 172.21.15.43:0/2624722993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95b81535e0 msgr2=0x7f95b81f1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:19.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.149+0000 7f95c03c3640 1 --2- 172.21.15.43:0/2624722993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95b81535e0 0x7f95b81f1650 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95ac000c00 tx=0x7f95ac003910 comp rx=0 tx=0).stop 2024-09-17T04:35:19.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.150+0000 7f95c03c3640 1 -- 172.21.15.43:0/2624722993 shutdown_connections 2024-09-17T04:35:19.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.150+0000 7f95c03c3640 1 --2- 172.21.15.43:0/2624722993 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f95a4078bc0 0x7f95a407b0d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.150+0000 7f95c03c3640 1 --2- 172.21.15.43:0/2624722993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95b81539f0 0x7f95b81e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.150+0000 7f95c03c3640 1 --2- 172.21.15.43:0/2624722993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95b81535e0 0x7f95b81f1650 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.150+0000 7f95c03c3640 1 --2- 172.21.15.43:0/2624722993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95b80c7570 0x7f95b80c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.150+0000 7f95c03c3640 1 -- 172.21.15.43:0/2624722993 >> 172.21.15.43:0/2624722993 conn(0x7f95b80738e0 msgr2=0x7f95b814cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:19.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.150+0000 7f95c03c3640 1 -- 172.21.15.43:0/2624722993 shutdown_connections 2024-09-17T04:35:19.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.150+0000 7f95c03c3640 1 -- 172.21.15.43:0/2624722993 wait complete. 2024-09-17T04:35:19.161 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-17T04:35:18.896510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595590,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":226,"num_write_kb":1666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240008,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734712,"statfs":{"total":773094113280,"available":772848345088,"internally_reserved":0,"allocated":3088384,"data_stored":1803548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003258"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079958+0000","last_change":"2024-09-17T04:34:52.082794+0000","last_active":"2024-09-17T04:34:53.079958+0000","last_peered":"2024-09-17T04:34:53.079958+0000","last_clean":"2024-09-17T04:34:53.079958+0000","last_became_active":"2024-09-17T04:34:52.081216+0000","last_became_peered":"2024-09-17T04:34:52.081216+0000","last_unstale":"2024-09-17T04:34:53.079958+0000","last_undegraded":"2024-09-17T04:34:53.079958+0000","last_fullsized":"2024-09-17T04:34:53.079958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:32.229667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075998+0000","last_change":"2024-09-17T04:34:52.071762+0000","last_active":"2024-09-17T04:34:53.075998+0000","last_peered":"2024-09-17T04:34:53.075998+0000","last_clean":"2024-09-17T04:34:53.075998+0000","last_became_active":"2024-09-17T04:34:52.071488+0000","last_became_peered":"2024-09-17T04:34:52.071488+0000","last_unstale":"2024-09-17T04:34:53.075998+0000","last_undegraded":"2024-09-17T04:34:53.075998+0000","last_fullsized":"2024-09-17T04:34:53.075998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:00.729921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315645+0000","last_change":"2024-09-17T04:34:52.073360+0000","last_active":"2024-09-17T04:34:53.315645+0000","last_peered":"2024-09-17T04:34:53.315645+0000","last_clean":"2024-09-17T04:34:53.315645+0000","last_became_active":"2024-09-17T04:34:52.073014+0000","last_became_peered":"2024-09-17T04:34:52.073014+0000","last_unstale":"2024-09-17T04:34:53.315645+0000","last_undegraded":"2024-09-17T04:34:53.315645+0000","last_fullsized":"2024-09-17T04:34:53.315645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:14.331608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081622+0000","last_change":"2024-09-17T04:34:52.077679+0000","last_active":"2024-09-17T04:34:53.081622+0000","last_peered":"2024-09-17T04:34:53.081622+0000","last_clean":"2024-09-17T04:34:53.081622+0000","last_became_active":"2024-09-17T04:34:52.077306+0000","last_became_peered":"2024-09-17T04:34:52.077306+0000","last_unstale":"2024-09-17T04:34:53.081622+0000","last_undegraded":"2024-09-17T04:34:53.081622+0000","last_fullsized":"2024-09-17T04:34:53.081622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:44.967159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080748+0000","last_change":"2024-09-17T04:34:52.075036+0000","last_active":"2024-09-17T04:34:53.080748+0000","last_peered":"2024-09-17T04:34:53.080748+0000","last_clean":"2024-09-17T04:34:53.080748+0000","last_became_active":"2024-09-17T04:34:52.074649+0000","last_became_peered":"2024-09-17T04:34:52.074649+0000","last_unstale":"2024-09-17T04:34:53.080748+0000","last_undegraded":"2024-09-17T04:34:53.080748+0000","last_fullsized":"2024-09-17T04:34:53.080748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:22.293746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081410+0000","last_change":"2024-09-17T04:34:52.081059+0000","last_active":"2024-09-17T04:34:53.081410+0000","last_peered":"2024-09-17T04:34:53.081410+0000","last_clean":"2024-09-17T04:34:53.081410+0000","last_became_active":"2024-09-17T04:34:52.080677+0000","last_became_peered":"2024-09-17T04:34:52.080677+0000","last_unstale":"2024-09-17T04:34:53.081410+0000","last_undegraded":"2024-09-17T04:34:53.081410+0000","last_fullsized":"2024-09-17T04:34:53.081410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:52.404672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079328+0000","last_change":"2024-09-17T04:34:52.071135+0000","last_active":"2024-09-17T04:34:53.079328+0000","last_peered":"2024-09-17T04:34:53.079328+0000","last_clean":"2024-09-17T04:34:53.079328+0000","last_became_active":"2024-09-17T04:34:52.070844+0000","last_became_peered":"2024-09-17T04:34:52.070844+0000","last_unstale":"2024-09-17T04:34:53.079328+0000","last_undegraded":"2024-09-17T04:34:53.079328+0000","last_fullsized":"2024-09-17T04:34:53.079328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:02.373675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176836+0000","last_change":"2024-09-17T04:34:52.083343+0000","last_active":"2024-09-17T04:34:53.176836+0000","last_peered":"2024-09-17T04:34:53.176836+0000","last_clean":"2024-09-17T04:34:53.176836+0000","last_became_active":"2024-09-17T04:34:52.083008+0000","last_became_peered":"2024-09-17T04:34:52.083008+0000","last_unstale":"2024-09-17T04:34:53.176836+0000","last_undegraded":"2024-09-17T04:34:53.176836+0000","last_fullsized":"2024-09-17T04:34:53.176836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:02.710077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079639+0000","last_change":"2024-09-17T04:34:52.083331+0000","last_active":"2024-09-17T04:34:53.079639+0000","last_peered":"2024-09-17T04:34:53.079639+0000","last_clean":"2024-09-17T04:34:53.079639+0000","last_became_active":"2024-09-17T04:34:52.082984+0000","last_became_peered":"2024-09-17T04:34:52.082984+0000","last_unstale":"2024-09-17T04:34:53.079639+0000","last_undegraded":"2024-09-17T04:34:53.079639+0000","last_fullsized":"2024-09-17T04:34:53.079639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:56.779776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080623+0000","last_change":"2024-09-17T04:34:52.087207+0000","last_active":"2024-09-17T04:34:53.080623+0000","last_peered":"2024-09-17T04:34:53.080623+0000","last_clean":"2024-09-17T04:34:53.080623+0000","last_became_active":"2024-09-17T04:34:52.086885+0000","last_became_peered":"2024-09-17T04:34:52.086885+0000","last_unstale":"2024-09-17T04:34:53.080623+0000","last_undegraded":"2024-09-17T04:34:53.080623+0000","last_fullsized":"2024-09-17T04:34:53.080623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:52.121338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.078802+0000","last_change":"2024-09-17T04:34:52.086309+0000","last_active":"2024-09-17T04:34:53.078802+0000","last_peered":"2024-09-17T04:34:53.078802+0000","last_clean":"2024-09-17T04:34:53.078802+0000","last_became_active":"2024-09-17T04:34:52.085996+0000","last_became_peered":"2024-09-17T04:34:52.085996+0000","last_unstale":"2024-09-17T04:34:53.078802+0000","last_undegraded":"2024-09-17T04:34:53.078802+0000","last_fullsized":"2024-09-17T04:34:53.078802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:58.004980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318081+0000","last_change":"2024-09-17T04:34:52.077080+0000","last_active":"2024-09-17T04:34:53.318081+0000","last_peered":"2024-09-17T04:34:53.318081+0000","last_clean":"2024-09-17T04:34:53.318081+0000","last_became_active":"2024-09-17T04:34:52.076756+0000","last_became_peered":"2024-09-17T04:34:52.076756+0000","last_unstale":"2024-09-17T04:34:53.318081+0000","last_undegraded":"2024-09-17T04:34:53.318081+0000","last_fullsized":"2024-09-17T04:34:53.318081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:48.044400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177180+0000","last_change":"2024-09-17T04:34:52.076609+0000","last_active":"2024-09-17T04:34:53.177180+0000","last_peered":"2024-09-17T04:34:53.177180+0000","last_clean":"2024-09-17T04:34:53.177180+0000","last_became_active":"2024-09-17T04:34:52.076277+0000","last_became_peered":"2024-09-17T04:34:52.076277+0000","last_unstale":"2024-09-17T04:34:53.177180+0000","last_undegraded":"2024-09-17T04:34:53.177180+0000","last_fullsized":"2024-09-17T04:34:53.177180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:28.537566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315331+0000","last_change":"2024-09-17T04:34:52.076754+0000","last_active":"2024-09-17T04:34:53.315331+0000","last_peered":"2024-09-17T04:34:53.315331+0000","last_clean":"2024-09-17T04:34:53.315331+0000","last_became_active":"2024-09-17T04:34:52.076261+0000","last_became_peered":"2024-09-17T04:34:52.076261+0000","last_unstale":"2024-09-17T04:34:53.315331+0000","last_undegraded":"2024-09-17T04:34:53.315331+0000","last_fullsized":"2024-09-17T04:34:53.315331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:51.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075849+0000","last_change":"2024-09-17T04:34:52.079161+0000","last_active":"2024-09-17T04:34:53.075849+0000","last_peered":"2024-09-17T04:34:53.075849+0000","last_clean":"2024-09-17T04:34:53.075849+0000","last_became_active":"2024-09-17T04:34:52.078782+0000","last_became_peered":"2024-09-17T04:34:52.078782+0000","last_unstale":"2024-09-17T04:34:53.075849+0000","last_undegraded":"2024-09-17T04:34:53.075849+0000","last_fullsized":"2024-09-17T04:34:53.075849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:06.894137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080646+0000","last_change":"2024-09-17T04:34:52.070767+0000","last_active":"2024-09-17T04:34:53.080646+0000","last_peered":"2024-09-17T04:34:53.080646+0000","last_clean":"2024-09-17T04:34:53.080646+0000","last_became_active":"2024-09-17T04:34:52.070428+0000","last_became_peered":"2024-09-17T04:34:52.070428+0000","last_unstale":"2024-09-17T04:34:53.080646+0000","last_undegraded":"2024-09-17T04:34:53.080646+0000","last_fullsized":"2024-09-17T04:34:53.080646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:42.820391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.082014+0000","last_change":"2024-09-17T04:34:52.077238+0000","last_active":"2024-09-17T04:34:53.082014+0000","last_peered":"2024-09-17T04:34:53.082014+0000","last_clean":"2024-09-17T04:34:53.082014+0000","last_became_active":"2024-09-17T04:34:52.076897+0000","last_became_peered":"2024-09-17T04:34:52.076897+0000","last_unstale":"2024-09-17T04:34:53.082014+0000","last_undegraded":"2024-09-17T04:34:53.082014+0000","last_fullsized":"2024-09-17T04:34:53.082014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:27.431184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.316114+0000","last_change":"2024-09-17T04:34:52.080917+0000","last_active":"2024-09-17T04:34:53.316114+0000","last_peered":"2024-09-17T04:34:53.316114+0000","last_clean":"2024-09-17T04:34:53.316114+0000","last_became_active":"2024-09-17T04:34:52.080597+0000","last_became_peered":"2024-09-17T04:34:52.080597+0000","last_unstale":"2024-09-17T04:34:53.316114+0000","last_undegraded":"2024-09-17T04:34:53.316114+0000","last_fullsized":"2024-09-17T04:34:53.316114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:10.560075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080159+0000","last_change":"2024-09-17T04:34:52.077284+0000","last_active":"2024-09-17T04:34:53.080159+0000","last_peered":"2024-09-17T04:34:53.080159+0000","last_clean":"2024-09-17T04:34:53.080159+0000","last_became_active":"2024-09-17T04:34:52.076950+0000","last_became_peered":"2024-09-17T04:34:52.076950+0000","last_unstale":"2024-09-17T04:34:53.080159+0000","last_undegraded":"2024-09-17T04:34:53.080159+0000","last_fullsized":"2024-09-17T04:34:53.080159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:06.361530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079837+0000","last_change":"2024-09-17T04:34:52.083859+0000","last_active":"2024-09-17T04:34:53.079837+0000","last_peered":"2024-09-17T04:34:53.079837+0000","last_clean":"2024-09-17T04:34:53.079837+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:34:53.079837+0000","last_undegraded":"2024-09-17T04:34:53.079837+0000","last_fullsized":"2024-09-17T04:34:53.079837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:25.262925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315556+0000","last_change":"2024-09-17T04:34:52.086460+0000","last_active":"2024-09-17T04:34:53.315556+0000","last_peered":"2024-09-17T04:34:53.315556+0000","last_clean":"2024-09-17T04:34:53.315556+0000","last_became_active":"2024-09-17T04:34:52.084848+0000","last_became_peered":"2024-09-17T04:34:52.084848+0000","last_unstale":"2024-09-17T04:34:53.315556+0000","last_undegraded":"2024-09-17T04:34:53.315556+0000","last_fullsized":"2024-09-17T04:34:53.315556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:22.927331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081424+0000","last_change":"2024-09-17T04:34:52.080149+0000","last_active":"2024-09-17T04:34:53.081424+0000","last_peered":"2024-09-17T04:34:53.081424+0000","last_clean":"2024-09-17T04:34:53.081424+0000","last_became_active":"2024-09-17T04:34:52.079490+0000","last_became_peered":"2024-09-17T04:34:52.079490+0000","last_unstale":"2024-09-17T04:34:53.081424+0000","last_undegraded":"2024-09-17T04:34:53.081424+0000","last_fullsized":"2024-09-17T04:34:53.081424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:52.314715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176860+0000","last_change":"2024-09-17T04:34:52.082765+0000","last_active":"2024-09-17T04:34:53.176860+0000","last_peered":"2024-09-17T04:34:53.176860+0000","last_clean":"2024-09-17T04:34:53.176860+0000","last_became_active":"2024-09-17T04:34:52.081049+0000","last_became_peered":"2024-09-17T04:34:52.081049+0000","last_unstale":"2024-09-17T04:34:53.176860+0000","last_undegraded":"2024-09-17T04:34:53.176860+0000","last_fullsized":"2024-09-17T04:34:53.176860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.762553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081112+0000","last_change":"2024-09-17T04:34:52.086233+0000","last_active":"2024-09-17T04:34:53.081112+0000","last_peered":"2024-09-17T04:34:53.081112+0000","last_clean":"2024-09-17T04:34:53.081112+0000","last_became_active":"2024-09-17T04:34:52.085876+0000","last_became_peered":"2024-09-17T04:34:52.085876+0000","last_unstale":"2024-09-17T04:34:53.081112+0000","last_undegraded":"2024-09-17T04:34:53.081112+0000","last_fullsized":"2024-09-17T04:34:53.081112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:44.061677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177349+0000","last_change":"2024-09-17T04:34:52.079305+0000","last_active":"2024-09-17T04:34:53.177349+0000","last_peered":"2024-09-17T04:34:53.177349+0000","last_clean":"2024-09-17T04:34:53.177349+0000","last_became_active":"2024-09-17T04:34:52.078984+0000","last_became_peered":"2024-09-17T04:34:52.078984+0000","last_unstale":"2024-09-17T04:34:53.177349+0000","last_undegraded":"2024-09-17T04:34:53.177349+0000","last_fullsized":"2024-09-17T04:34:53.177349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:15.927488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080877+0000","last_change":"2024-09-17T04:34:52.077495+0000","last_active":"2024-09-17T04:34:53.080877+0000","last_peered":"2024-09-17T04:34:53.080877+0000","last_clean":"2024-09-17T04:34:53.080877+0000","last_became_active":"2024-09-17T04:34:52.077167+0000","last_became_peered":"2024-09-17T04:34:52.077167+0000","last_unstale":"2024-09-17T04:34:53.080877+0000","last_undegraded":"2024-09-17T04:34:53.080877+0000","last_fullsized":"2024-09-17T04:34:53.080877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.411611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076209+0000","last_change":"2024-09-17T04:34:52.077389+0000","last_active":"2024-09-17T04:34:53.076209+0000","last_peered":"2024-09-17T04:34:53.076209+0000","last_clean":"2024-09-17T04:34:53.076209+0000","last_became_active":"2024-09-17T04:34:52.076993+0000","last_became_peered":"2024-09-17T04:34:52.076993+0000","last_unstale":"2024-09-17T04:34:53.076209+0000","last_undegraded":"2024-09-17T04:34:53.076209+0000","last_fullsized":"2024-09-17T04:34:53.076209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:18.540098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177228+0000","last_change":"2024-09-17T04:34:52.080545+0000","last_active":"2024-09-17T04:34:53.177228+0000","last_peered":"2024-09-17T04:34:53.177228+0000","last_clean":"2024-09-17T04:34:53.177228+0000","last_became_active":"2024-09-17T04:34:52.079930+0000","last_became_peered":"2024-09-17T04:34:52.079930+0000","last_unstale":"2024-09-17T04:34:53.177228+0000","last_undegraded":"2024-09-17T04:34:53.177228+0000","last_fullsized":"2024-09-17T04:34:53.177228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:50.491050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315714+0000","last_change":"2024-09-17T04:34:52.083598+0000","last_active":"2024-09-17T04:34:53.315714+0000","last_peered":"2024-09-17T04:34:53.315714+0000","last_clean":"2024-09-17T04:34:53.315714+0000","last_became_active":"2024-09-17T04:34:52.083225+0000","last_became_peered":"2024-09-17T04:34:52.083225+0000","last_unstale":"2024-09-17T04:34:53.315714+0000","last_undegraded":"2024-09-17T04:34:53.315714+0000","last_fullsized":"2024-09-17T04:34:53.315714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:22.713546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081731+0000","last_change":"2024-09-17T04:34:52.078977+0000","last_active":"2024-09-17T04:34:53.081731+0000","last_peered":"2024-09-17T04:34:53.081731+0000","last_clean":"2024-09-17T04:34:53.081731+0000","last_became_active":"2024-09-17T04:34:52.078636+0000","last_became_peered":"2024-09-17T04:34:52.078636+0000","last_unstale":"2024-09-17T04:34:53.081731+0000","last_undegraded":"2024-09-17T04:34:53.081731+0000","last_fullsized":"2024-09-17T04:34:53.081731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:30.144564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315840+0000","last_change":"2024-09-17T04:34:52.082113+0000","last_active":"2024-09-17T04:34:53.315840+0000","last_peered":"2024-09-17T04:34:53.315840+0000","last_clean":"2024-09-17T04:34:53.315840+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:34:53.315840+0000","last_undegraded":"2024-09-17T04:34:53.315840+0000","last_fullsized":"2024-09-17T04:34:53.315840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:52.744564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.078708+0000","last_change":"2024-09-17T04:34:52.083306+0000","last_active":"2024-09-17T04:34:53.078708+0000","last_peered":"2024-09-17T04:34:53.078708+0000","last_clean":"2024-09-17T04:34:53.078708+0000","last_became_active":"2024-09-17T04:34:52.082590+0000","last_became_peered":"2024-09-17T04:34:52.082590+0000","last_unstale":"2024-09-17T04:34:53.078708+0000","last_undegraded":"2024-09-17T04:34:53.078708+0000","last_fullsized":"2024-09-17T04:34:53.078708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:21.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.317989+0000","last_change":"2024-09-17T04:34:52.070155+0000","last_active":"2024-09-17T04:34:53.317989+0000","last_peered":"2024-09-17T04:34:53.317989+0000","last_clean":"2024-09-17T04:34:53.317989+0000","last_became_active":"2024-09-17T04:34:52.069498+0000","last_became_peered":"2024-09-17T04:34:52.069498+0000","last_unstale":"2024-09-17T04:34:53.317989+0000","last_undegraded":"2024-09-17T04:34:53.317989+0000","last_fullsized":"2024-09-17T04:34:53.317989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:24.539277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'5","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.117769+0000","last_change":"2024-09-17T04:34:51.074188+0000","last_active":"2024-09-17T04:35:03.117769+0000","last_peered":"2024-09-17T04:35:03.117769+0000","last_clean":"2024-09-17T04:35:03.117769+0000","last_became_active":"2024-09-17T04:34:51.073740+0000","last_became_peered":"2024-09-17T04:34:51.073740+0000","last_unstale":"2024-09-17T04:35:03.117769+0000","last_undegraded":"2024-09-17T04:35:03.117769+0000","last_fullsized":"2024-09-17T04:35:03.117769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:36.692687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315954+0000","last_change":"2024-09-17T04:34:52.081048+0000","last_active":"2024-09-17T04:34:53.315954+0000","last_peered":"2024-09-17T04:34:53.315954+0000","last_clean":"2024-09-17T04:34:53.315954+0000","last_became_active":"2024-09-17T04:34:52.080703+0000","last_became_peered":"2024-09-17T04:34:52.080703+0000","last_unstale":"2024-09-17T04:34:53.315954+0000","last_undegraded":"2024-09-17T04:34:53.315954+0000","last_fullsized":"2024-09-17T04:34:53.315954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:05.164849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.134261+0000","last_change":"2024-09-17T04:34:51.078602+0000","last_active":"2024-09-17T04:35:09.134261+0000","last_peered":"2024-09-17T04:35:09.134261+0000","last_clean":"2024-09-17T04:35:09.134261+0000","last_became_active":"2024-09-17T04:34:51.078221+0000","last_became_peered":"2024-09-17T04:34:51.078221+0000","last_unstale":"2024-09-17T04:35:09.134261+0000","last_undegraded":"2024-09-17T04:35:09.134261+0000","last_fullsized":"2024-09-17T04:35:09.134261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:59.716216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.133892+0000","last_change":"2024-09-17T04:34:51.077573+0000","last_active":"2024-09-17T04:35:09.133892+0000","last_peered":"2024-09-17T04:35:09.133892+0000","last_clean":"2024-09-17T04:35:09.133892+0000","last_became_active":"2024-09-17T04:34:51.077225+0000","last_became_peered":"2024-09-17T04:34:51.077225+0000","last_unstale":"2024-09-17T04:35:09.133892+0000","last_undegraded":"2024-09-17T04:35:09.133892+0000","last_fullsized":"2024-09-17T04:35:09.133892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:29.348927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.176928+0000","last_change":"2024-09-17T04:34:52.074356+0000","last_active":"2024-09-17T04:34:53.176928+0000","last_peered":"2024-09-17T04:34:53.176928+0000","last_clean":"2024-09-17T04:34:53.176928+0000","last_became_active":"2024-09-17T04:34:52.072796+0000","last_became_peered":"2024-09-17T04:34:52.072796+0000","last_unstale":"2024-09-17T04:34:53.176928+0000","last_undegraded":"2024-09-17T04:34:53.176928+0000","last_fullsized":"2024-09-17T04:34:53.176928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:53.971839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081206+0000","last_change":"2024-09-17T04:34:51.074170+0000","last_active":"2024-09-17T04:34:53.081206+0000","last_peered":"2024-09-17T04:34:53.081206+0000","last_clean":"2024-09-17T04:34:53.081206+0000","last_became_active":"2024-09-17T04:34:51.073836+0000","last_became_peered":"2024-09-17T04:34:51.073836+0000","last_unstale":"2024-09-17T04:34:53.081206+0000","last_undegraded":"2024-09-17T04:34:53.081206+0000","last_fullsized":"2024-09-17T04:34:53.081206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:30.884002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075826+0000","last_change":"2024-09-17T04:34:52.078331+0000","last_active":"2024-09-17T04:34:53.075826+0000","last_peered":"2024-09-17T04:34:53.075826+0000","last_clean":"2024-09-17T04:34:53.075826+0000","last_became_active":"2024-09-17T04:34:52.078012+0000","last_became_peered":"2024-09-17T04:34:52.078012+0000","last_unstale":"2024-09-17T04:34:53.075826+0000","last_undegraded":"2024-09-17T04:34:53.075826+0000","last_fullsized":"2024-09-17T04:34:53.075826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:28.961571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.115412+0000","last_change":"2024-09-17T04:34:51.077676+0000","last_active":"2024-09-17T04:35:03.115412+0000","last_peered":"2024-09-17T04:35:03.115412+0000","last_clean":"2024-09-17T04:35:03.115412+0000","last_became_active":"2024-09-17T04:34:51.076291+0000","last_became_peered":"2024-09-17T04:34:51.076291+0000","last_unstale":"2024-09-17T04:35:03.115412+0000","last_undegraded":"2024-09-17T04:35:03.115412+0000","last_fullsized":"2024-09-17T04:35:03.115412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:42.622688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081329+0000","last_change":"2024-09-17T04:34:52.075624+0000","last_active":"2024-09-17T04:34:53.081329+0000","last_peered":"2024-09-17T04:34:53.081329+0000","last_clean":"2024-09-17T04:34:53.081329+0000","last_became_active":"2024-09-17T04:34:52.074943+0000","last_became_peered":"2024-09-17T04:34:52.074943+0000","last_unstale":"2024-09-17T04:34:53.081329+0000","last_undegraded":"2024-09-17T04:34:53.081329+0000","last_fullsized":"2024-09-17T04:34:53.081329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:56.749605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.117301+0000","last_change":"2024-09-17T04:34:51.077199+0000","last_active":"2024-09-17T04:35:03.117301+0000","last_peered":"2024-09-17T04:35:03.117301+0000","last_clean":"2024-09-17T04:35:03.117301+0000","last_became_active":"2024-09-17T04:34:51.076867+0000","last_became_peered":"2024-09-17T04:34:51.076867+0000","last_unstale":"2024-09-17T04:35:03.117301+0000","last_undegraded":"2024-09-17T04:35:03.117301+0000","last_fullsized":"2024-09-17T04:35:03.117301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:09.194133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315797+0000","last_change":"2024-09-17T04:34:52.083401+0000","last_active":"2024-09-17T04:34:53.315797+0000","last_peered":"2024-09-17T04:34:53.315797+0000","last_clean":"2024-09-17T04:34:53.315797+0000","last_became_active":"2024-09-17T04:34:52.083086+0000","last_became_peered":"2024-09-17T04:34:52.083086+0000","last_unstale":"2024-09-17T04:34:53.315797+0000","last_undegraded":"2024-09-17T04:34:53.315797+0000","last_fullsized":"2024-09-17T04:34:53.315797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.237945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.070202+0000","last_change":"2024-09-17T04:34:51.070235+0000","last_active":"2024-09-17T04:34:57.070202+0000","last_peered":"2024-09-17T04:34:57.070202+0000","last_clean":"2024-09-17T04:34:57.070202+0000","last_became_active":"2024-09-17T04:34:51.069278+0000","last_became_peered":"2024-09-17T04:34:51.069278+0000","last_unstale":"2024-09-17T04:34:57.070202+0000","last_undegraded":"2024-09-17T04:34:57.070202+0000","last_fullsized":"2024-09-17T04:34:57.070202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:55.959278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318073+0000","last_change":"2024-09-17T04:34:52.076233+0000","last_active":"2024-09-17T04:34:53.318073+0000","last_peered":"2024-09-17T04:34:53.318073+0000","last_clean":"2024-09-17T04:34:53.318073+0000","last_became_active":"2024-09-17T04:34:52.075682+0000","last_became_peered":"2024-09-17T04:34:52.075682+0000","last_unstale":"2024-09-17T04:34:53.318073+0000","last_undegraded":"2024-09-17T04:34:53.318073+0000","last_fullsized":"2024-09-17T04:34:53.318073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:22.047574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.114213+0000","last_change":"2024-09-17T04:34:51.076416+0000","last_active":"2024-09-17T04:35:03.114213+0000","last_peered":"2024-09-17T04:35:03.114213+0000","last_clean":"2024-09-17T04:35:03.114213+0000","last_became_active":"2024-09-17T04:34:51.076051+0000","last_became_peered":"2024-09-17T04:34:51.076051+0000","last_unstale":"2024-09-17T04:35:03.114213+0000","last_undegraded":"2024-09-17T04:35:03.114213+0000","last_fullsized":"2024-09-17T04:35:03.114213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:52.255204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079732+0000","last_change":"2024-09-17T04:34:52.086230+0000","last_active":"2024-09-17T04:34:53.079732+0000","last_peered":"2024-09-17T04:34:53.079732+0000","last_clean":"2024-09-17T04:34:53.079732+0000","last_became_active":"2024-09-17T04:34:52.085910+0000","last_became_peered":"2024-09-17T04:34:52.085910+0000","last_unstale":"2024-09-17T04:34:53.079732+0000","last_undegraded":"2024-09-17T04:34:53.079732+0000","last_fullsized":"2024-09-17T04:34:53.079732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:36.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.133250+0000","last_change":"2024-09-17T04:34:51.075224+0000","last_active":"2024-09-17T04:35:09.133250+0000","last_peered":"2024-09-17T04:35:09.133250+0000","last_clean":"2024-09-17T04:35:09.133250+0000","last_became_active":"2024-09-17T04:34:51.074912+0000","last_became_peered":"2024-09-17T04:34:51.074912+0000","last_unstale":"2024-09-17T04:35:09.133250+0000","last_undegraded":"2024-09-17T04:35:09.133250+0000","last_fullsized":"2024-09-17T04:35:09.133250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:33.811243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315617+0000","last_change":"2024-09-17T04:34:52.085906+0000","last_active":"2024-09-17T04:34:53.315617+0000","last_peered":"2024-09-17T04:34:53.315617+0000","last_clean":"2024-09-17T04:34:53.315617+0000","last_became_active":"2024-09-17T04:34:52.085538+0000","last_became_peered":"2024-09-17T04:34:52.085538+0000","last_unstale":"2024-09-17T04:34:53.315617+0000","last_undegraded":"2024-09-17T04:34:53.315617+0000","last_fullsized":"2024-09-17T04:34:53.315617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:21.997395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.115092+0000","last_change":"2024-09-17T04:34:51.074253+0000","last_active":"2024-09-17T04:35:03.115092+0000","last_peered":"2024-09-17T04:35:03.115092+0000","last_clean":"2024-09-17T04:35:03.115092+0000","last_became_active":"2024-09-17T04:34:51.073812+0000","last_became_peered":"2024-09-17T04:34:51.073812+0000","last_unstale":"2024-09-17T04:35:03.115092+0000","last_undegraded":"2024-09-17T04:35:03.115092+0000","last_fullsized":"2024-09-17T04:35:03.115092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:38.971561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081022+0000","last_change":"2024-09-17T04:34:52.082137+0000","last_active":"2024-09-17T04:34:53.081022+0000","last_peered":"2024-09-17T04:34:53.081022+0000","last_clean":"2024-09-17T04:34:53.081022+0000","last_became_active":"2024-09-17T04:34:52.081775+0000","last_became_peered":"2024-09-17T04:34:52.081775+0000","last_unstale":"2024-09-17T04:34:53.081022+0000","last_undegraded":"2024-09-17T04:34:53.081022+0000","last_fullsized":"2024-09-17T04:34:53.081022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:57.911822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.135451+0000","last_change":"2024-09-17T04:34:51.077157+0000","last_active":"2024-09-17T04:35:09.135451+0000","last_peered":"2024-09-17T04:35:09.135451+0000","last_clean":"2024-09-17T04:35:09.135451+0000","last_became_active":"2024-09-17T04:34:51.076797+0000","last_became_peered":"2024-09-17T04:34:51.076797+0000","last_unstale":"2024-09-17T04:35:09.135451+0000","last_undegraded":"2024-09-17T04:35:09.135451+0000","last_fullsized":"2024-09-17T04:35:09.135451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:20.118978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079355+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:34:53.079355+0000","last_peered":"2024-09-17T04:34:53.079355+0000","last_clean":"2024-09-17T04:34:53.079355+0000","last_became_active":"2024-09-17T04:34:52.082118+0000","last_became_peered":"2024-09-17T04:34:52.082118+0000","last_unstale":"2024-09-17T04:34:53.079355+0000","last_undegraded":"2024-09-17T04:34:53.079355+0000","last_fullsized":"2024-09-17T04:34:53.079355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:44.752945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'15","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.135849+0000","last_change":"2024-09-17T04:34:51.071083+0000","last_active":"2024-09-17T04:35:09.135849+0000","last_peered":"2024-09-17T04:35:09.135849+0000","last_clean":"2024-09-17T04:35:09.135849+0000","last_became_active":"2024-09-17T04:34:51.070733+0000","last_became_peered":"2024-09-17T04:34:51.070733+0000","last_unstale":"2024-09-17T04:35:09.135849+0000","last_undegraded":"2024-09-17T04:35:09.135849+0000","last_fullsized":"2024-09-17T04:35:09.135849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:36.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079638+0000","last_change":"2024-09-17T04:34:52.080277+0000","last_active":"2024-09-17T04:34:53.079638+0000","last_peered":"2024-09-17T04:34:53.079638+0000","last_clean":"2024-09-17T04:34:53.079638+0000","last_became_active":"2024-09-17T04:34:52.079969+0000","last_became_peered":"2024-09-17T04:34:52.079969+0000","last_unstale":"2024-09-17T04:34:53.079638+0000","last_undegraded":"2024-09-17T04:34:53.079638+0000","last_fullsized":"2024-09-17T04:34:53.079638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:10.360905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.064001+0000","last_change":"2024-09-17T04:34:51.074800+0000","last_active":"2024-09-17T04:34:57.064001+0000","last_peered":"2024-09-17T04:34:57.064001+0000","last_clean":"2024-09-17T04:34:57.064001+0000","last_became_active":"2024-09-17T04:34:51.073287+0000","last_became_peered":"2024-09-17T04:34:51.073287+0000","last_unstale":"2024-09-17T04:34:57.064001+0000","last_undegraded":"2024-09-17T04:34:57.064001+0000","last_fullsized":"2024-09-17T04:34:57.064001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:19.933857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079619+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:34:53.079619+0000","last_peered":"2024-09-17T04:34:53.079619+0000","last_clean":"2024-09-17T04:34:53.079619+0000","last_became_active":"2024-09-17T04:34:52.082607+0000","last_became_peered":"2024-09-17T04:34:52.082607+0000","last_unstale":"2024-09-17T04:34:53.079619+0000","last_undegraded":"2024-09-17T04:34:53.079619+0000","last_fullsized":"2024-09-17T04:34:53.079619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:08.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.064837+0000","last_change":"2024-09-17T04:34:51.077171+0000","last_active":"2024-09-17T04:34:57.064837+0000","last_peered":"2024-09-17T04:34:57.064837+0000","last_clean":"2024-09-17T04:34:57.064837+0000","last_became_active":"2024-09-17T04:34:51.076780+0000","last_became_peered":"2024-09-17T04:34:51.076780+0000","last_unstale":"2024-09-17T04:34:57.064837+0000","last_undegraded":"2024-09-17T04:34:57.064837+0000","last_fullsized":"2024-09-17T04:34:57.064837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:40.031852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079942+0000","last_change":"2024-09-17T04:34:52.080032+0000","last_active":"2024-09-17T04:34:53.079942+0000","last_peered":"2024-09-17T04:34:53.079942+0000","last_clean":"2024-09-17T04:34:53.079942+0000","last_became_active":"2024-09-17T04:34:52.079536+0000","last_became_peered":"2024-09-17T04:34:52.079536+0000","last_unstale":"2024-09-17T04:34:53.079942+0000","last_undegraded":"2024-09-17T04:34:53.079942+0000","last_fullsized":"2024-09-17T04:34:53.079942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:55.220027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:54.608800+0000","last_change":"2024-09-17T04:34:51.071053+0000","last_active":"2024-09-17T04:34:54.608800+0000","last_peered":"2024-09-17T04:34:54.608800+0000","last_clean":"2024-09-17T04:34:54.608800+0000","last_became_active":"2024-09-17T04:34:51.070673+0000","last_became_peered":"2024-09-17T04:34:51.070673+0000","last_unstale":"2024-09-17T04:34:54.608800+0000","last_undegraded":"2024-09-17T04:34:54.608800+0000","last_fullsized":"2024-09-17T04:34:54.608800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:31.660200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081894+0000","last_change":"2024-09-17T04:34:52.077963+0000","last_active":"2024-09-17T04:34:53.081894+0000","last_peered":"2024-09-17T04:34:53.081894+0000","last_clean":"2024-09-17T04:34:53.081894+0000","last_became_active":"2024-09-17T04:34:52.077499+0000","last_became_peered":"2024-09-17T04:34:52.077499+0000","last_unstale":"2024-09-17T04:34:53.081894+0000","last_undegraded":"2024-09-17T04:34:53.081894+0000","last_fullsized":"2024-09-17T04:34:53.081894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:25.309696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.134094+0000","last_change":"2024-09-17T04:34:51.070532+0000","last_active":"2024-09-17T04:35:09.134094+0000","last_peered":"2024-09-17T04:35:09.134094+0000","last_clean":"2024-09-17T04:35:09.134094+0000","last_became_active":"2024-09-17T04:34:51.070179+0000","last_became_peered":"2024-09-17T04:34:51.070179+0000","last_unstale":"2024-09-17T04:35:09.134094+0000","last_undegraded":"2024-09-17T04:35:09.134094+0000","last_fullsized":"2024-09-17T04:35:09.134094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:52.027096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079935+0000","last_change":"2024-09-17T04:34:52.083159+0000","last_active":"2024-09-17T04:34:53.079935+0000","last_peered":"2024-09-17T04:34:53.079935+0000","last_clean":"2024-09-17T04:34:53.079935+0000","last_became_active":"2024-09-17T04:34:52.082847+0000","last_became_peered":"2024-09-17T04:34:52.082847+0000","last_unstale":"2024-09-17T04:34:53.079935+0000","last_undegraded":"2024-09-17T04:34:53.079935+0000","last_fullsized":"2024-09-17T04:34:53.079935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:25.210506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080417+0000","last_change":"2024-09-17T04:34:41.975789+0000","last_active":"2024-09-17T04:34:53.080417+0000","last_peered":"2024-09-17T04:34:53.080417+0000","last_clean":"2024-09-17T04:34:53.080417+0000","last_became_active":"2024-09-17T04:34:41.974664+0000","last_became_peered":"2024-09-17T04:34:41.974664+0000","last_unstale":"2024-09-17T04:34:53.080417+0000","last_undegraded":"2024-09-17T04:34:53.080417+0000","last_fullsized":"2024-09-17T04:34:53.080417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_clean_scrub_stamp":"2024-09-17T04:34:39.702713+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:30.302931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.114706+0000","last_change":"2024-09-17T04:34:51.068782+0000","last_active":"2024-09-17T04:35:03.114706+0000","last_peered":"2024-09-17T04:35:03.114706+0000","last_clean":"2024-09-17T04:35:03.114706+0000","last_became_active":"2024-09-17T04:34:51.068375+0000","last_became_peered":"2024-09-17T04:34:51.068375+0000","last_unstale":"2024-09-17T04:35:03.114706+0000","last_undegraded":"2024-09-17T04:35:03.114706+0000","last_fullsized":"2024-09-17T04:35:03.114706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:25.307166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177343+0000","last_change":"2024-09-17T04:34:52.086768+0000","last_active":"2024-09-17T04:34:53.177343+0000","last_peered":"2024-09-17T04:34:53.177343+0000","last_clean":"2024-09-17T04:34:53.177343+0000","last_became_active":"2024-09-17T04:34:52.086415+0000","last_became_peered":"2024-09-17T04:34:52.086415+0000","last_unstale":"2024-09-17T04:34:53.177343+0000","last_undegraded":"2024-09-17T04:34:53.177343+0000","last_fullsized":"2024-09-17T04:34:53.177343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:45.527873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.133868+0000","last_change":"2024-09-17T04:34:51.075655+0000","last_active":"2024-09-17T04:35:09.133868+0000","last_peered":"2024-09-17T04:35:09.133868+0000","last_clean":"2024-09-17T04:35:09.133868+0000","last_became_active":"2024-09-17T04:34:51.075313+0000","last_became_peered":"2024-09-17T04:34:51.075313+0000","last_unstale":"2024-09-17T04:35:09.133868+0000","last_undegraded":"2024-09-17T04:35:09.133868+0000","last_fullsized":"2024-09-17T04:35:09.133868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:47.853850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315306+0000","last_change":"2024-09-17T04:34:52.080065+0000","last_active":"2024-09-17T04:34:53.315306+0000","last_peered":"2024-09-17T04:34:53.315306+0000","last_clean":"2024-09-17T04:34:53.315306+0000","last_became_active":"2024-09-17T04:34:52.079672+0000","last_became_peered":"2024-09-17T04:34:52.079672+0000","last_unstale":"2024-09-17T04:34:53.315306+0000","last_undegraded":"2024-09-17T04:34:53.315306+0000","last_fullsized":"2024-09-17T04:34:53.315306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:52.040153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.134345+0000","last_change":"2024-09-17T04:34:51.075960+0000","last_active":"2024-09-17T04:35:09.134345+0000","last_peered":"2024-09-17T04:35:09.134345+0000","last_clean":"2024-09-17T04:35:09.134345+0000","last_became_active":"2024-09-17T04:34:51.075561+0000","last_became_peered":"2024-09-17T04:34:51.075561+0000","last_unstale":"2024-09-17T04:35:09.134345+0000","last_undegraded":"2024-09-17T04:35:09.134345+0000","last_fullsized":"2024-09-17T04:35:09.134345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:44.834618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.075859+0000","last_change":"2024-09-17T04:34:52.070068+0000","last_active":"2024-09-17T04:34:53.075859+0000","last_peered":"2024-09-17T04:34:53.075859+0000","last_clean":"2024-09-17T04:34:53.075859+0000","last_became_active":"2024-09-17T04:34:52.069669+0000","last_became_peered":"2024-09-17T04:34:52.069669+0000","last_unstale":"2024-09-17T04:34:53.075859+0000","last_undegraded":"2024-09-17T04:34:53.075859+0000","last_fullsized":"2024-09-17T04:34:53.075859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:39.617045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081881+0000","last_change":"2024-09-17T04:34:51.070187+0000","last_active":"2024-09-17T04:34:53.081881+0000","last_peered":"2024-09-17T04:34:53.081881+0000","last_clean":"2024-09-17T04:34:53.081881+0000","last_became_active":"2024-09-17T04:34:51.069714+0000","last_became_peered":"2024-09-17T04:34:51.069714+0000","last_unstale":"2024-09-17T04:34:53.081881+0000","last_undegraded":"2024-09-17T04:34:53.081881+0000","last_fullsized":"2024-09-17T04:34:53.081881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:28.082690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318145+0000","last_change":"2024-09-17T04:34:52.069653+0000","last_active":"2024-09-17T04:34:53.318145+0000","last_peered":"2024-09-17T04:34:53.318145+0000","last_clean":"2024-09-17T04:34:53.318145+0000","last_became_active":"2024-09-17T04:34:52.069282+0000","last_became_peered":"2024-09-17T04:34:52.069282+0000","last_unstale":"2024-09-17T04:34:53.318145+0000","last_undegraded":"2024-09-17T04:34:53.318145+0000","last_fullsized":"2024-09-17T04:34:53.318145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:40.828725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076208+0000","last_change":"2024-09-17T04:34:51.070676+0000","last_active":"2024-09-17T04:34:53.076208+0000","last_peered":"2024-09-17T04:34:53.076208+0000","last_clean":"2024-09-17T04:34:53.076208+0000","last_became_active":"2024-09-17T04:34:51.069006+0000","last_became_peered":"2024-09-17T04:34:51.069006+0000","last_unstale":"2024-09-17T04:34:53.076208+0000","last_undegraded":"2024-09-17T04:34:53.076208+0000","last_fullsized":"2024-09-17T04:34:53.076208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:45.452865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081804+0000","last_change":"2024-09-17T04:34:52.087131+0000","last_active":"2024-09-17T04:34:53.081804+0000","last_peered":"2024-09-17T04:34:53.081804+0000","last_clean":"2024-09-17T04:34:53.081804+0000","last_became_active":"2024-09-17T04:34:52.086782+0000","last_became_peered":"2024-09-17T04:34:52.086782+0000","last_unstale":"2024-09-17T04:34:53.081804+0000","last_undegraded":"2024-09-17T04:34:53.081804+0000","last_fullsized":"2024-09-17T04:34:53.081804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:53.987579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.080543+0000","last_change":"2024-09-17T04:34:51.068708+0000","last_active":"2024-09-17T04:34:53.080543+0000","last_peered":"2024-09-17T04:34:53.080543+0000","last_clean":"2024-09-17T04:34:53.080543+0000","last_became_active":"2024-09-17T04:34:51.068354+0000","last_became_peered":"2024-09-17T04:34:51.068354+0000","last_unstale":"2024-09-17T04:34:53.080543+0000","last_undegraded":"2024-09-17T04:34:53.080543+0000","last_fullsized":"2024-09-17T04:34:53.080543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:04.219898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.076122+0000","last_change":"2024-09-17T04:34:52.071586+0000","last_active":"2024-09-17T04:34:53.076122+0000","last_peered":"2024-09-17T04:34:53.076122+0000","last_clean":"2024-09-17T04:34:53.076122+0000","last_became_active":"2024-09-17T04:34:52.071246+0000","last_became_peered":"2024-09-17T04:34:52.071246+0000","last_unstale":"2024-09-17T04:34:53.076122+0000","last_undegraded":"2024-09-17T04:34:53.076122+0000","last_fullsized":"2024-09-17T04:34:53.076122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:03.620107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.133594+0000","last_change":"2024-09-17T04:34:51.078947+0000","last_active":"2024-09-17T04:35:09.133594+0000","last_peered":"2024-09-17T04:35:09.133594+0000","last_clean":"2024-09-17T04:35:09.133594+0000","last_became_active":"2024-09-17T04:34:51.078557+0000","last_became_peered":"2024-09-17T04:34:51.078557+0000","last_unstale":"2024-09-17T04:35:09.133594+0000","last_undegraded":"2024-09-17T04:35:09.133594+0000","last_fullsized":"2024-09-17T04:35:09.133594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:51.413772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177384+0000","last_change":"2024-09-17T04:34:52.086372+0000","last_active":"2024-09-17T04:34:53.177384+0000","last_peered":"2024-09-17T04:34:53.177384+0000","last_clean":"2024-09-17T04:34:53.177384+0000","last_became_active":"2024-09-17T04:34:52.086018+0000","last_became_peered":"2024-09-17T04:34:52.086018+0000","last_unstale":"2024-09-17T04:34:53.177384+0000","last_undegraded":"2024-09-17T04:34:53.177384+0000","last_fullsized":"2024-09-17T04:34:53.177384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:10.818503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.115014+0000","last_change":"2024-09-17T04:34:51.076427+0000","last_active":"2024-09-17T04:35:03.115014+0000","last_peered":"2024-09-17T04:35:03.115014+0000","last_clean":"2024-09-17T04:35:03.115014+0000","last_became_active":"2024-09-17T04:34:51.075881+0000","last_became_peered":"2024-09-17T04:34:51.075881+0000","last_unstale":"2024-09-17T04:35:03.115014+0000","last_undegraded":"2024-09-17T04:35:03.115014+0000","last_fullsized":"2024-09-17T04:35:03.115014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:40.903989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315468+0000","last_change":"2024-09-17T04:34:52.076358+0000","last_active":"2024-09-17T04:34:53.315468+0000","last_peered":"2024-09-17T04:34:53.315468+0000","last_clean":"2024-09-17T04:34:53.315468+0000","last_became_active":"2024-09-17T04:34:52.076035+0000","last_became_peered":"2024-09-17T04:34:52.076035+0000","last_unstale":"2024-09-17T04:34:53.315468+0000","last_undegraded":"2024-09-17T04:34:53.315468+0000","last_fullsized":"2024-09-17T04:34:53.315468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:30.660617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.114379+0000","last_change":"2024-09-17T04:34:51.072737+0000","last_active":"2024-09-17T04:35:03.114379+0000","last_peered":"2024-09-17T04:35:03.114379+0000","last_clean":"2024-09-17T04:35:03.114379+0000","last_became_active":"2024-09-17T04:34:51.072378+0000","last_became_peered":"2024-09-17T04:34:51.072378+0000","last_unstale":"2024-09-17T04:35:03.114379+0000","last_undegraded":"2024-09-17T04:35:03.114379+0000","last_fullsized":"2024-09-17T04:35:03.114379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:27.364636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.318181+0000","last_change":"2024-09-17T04:34:52.068446+0000","last_active":"2024-09-17T04:34:53.318181+0000","last_peered":"2024-09-17T04:34:53.318181+0000","last_clean":"2024-09-17T04:34:53.318181+0000","last_became_active":"2024-09-17T04:34:52.068047+0000","last_became_peered":"2024-09-17T04:34:52.068047+0000","last_unstale":"2024-09-17T04:34:53.318181+0000","last_undegraded":"2024-09-17T04:34:53.318181+0000","last_fullsized":"2024-09-17T04:34:53.318181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:26.994189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.115076+0000","last_change":"2024-09-17T04:34:51.069539+0000","last_active":"2024-09-17T04:35:03.115076+0000","last_peered":"2024-09-17T04:35:03.115076+0000","last_clean":"2024-09-17T04:35:03.115076+0000","last_became_active":"2024-09-17T04:34:51.067438+0000","last_became_peered":"2024-09-17T04:34:51.067438+0000","last_unstale":"2024-09-17T04:35:03.115076+0000","last_undegraded":"2024-09-17T04:35:03.115076+0000","last_fullsized":"2024-09-17T04:35:03.115076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:13.078391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177144+0000","last_change":"2024-09-17T04:34:52.078035+0000","last_active":"2024-09-17T04:34:53.177144+0000","last_peered":"2024-09-17T04:34:53.177144+0000","last_clean":"2024-09-17T04:34:53.177144+0000","last_became_active":"2024-09-17T04:34:52.077708+0000","last_became_peered":"2024-09-17T04:34:52.077708+0000","last_unstale":"2024-09-17T04:34:53.177144+0000","last_undegraded":"2024-09-17T04:34:53.177144+0000","last_fullsized":"2024-09-17T04:34:53.177144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:00.313209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:54.608737+0000","last_change":"2024-09-17T04:34:51.074749+0000","last_active":"2024-09-17T04:34:54.608737+0000","last_peered":"2024-09-17T04:34:54.608737+0000","last_clean":"2024-09-17T04:34:54.608737+0000","last_became_active":"2024-09-17T04:34:51.074393+0000","last_became_peered":"2024-09-17T04:34:51.074393+0000","last_unstale":"2024-09-17T04:34:54.608737+0000","last_undegraded":"2024-09-17T04:34:54.608737+0000","last_fullsized":"2024-09-17T04:34:54.608737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:39.558815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177339+0000","last_change":"2024-09-17T04:34:52.075585+0000","last_active":"2024-09-17T04:34:53.177339+0000","last_peered":"2024-09-17T04:34:53.177339+0000","last_clean":"2024-09-17T04:34:53.177339+0000","last_became_active":"2024-09-17T04:34:52.075257+0000","last_became_peered":"2024-09-17T04:34:52.075257+0000","last_unstale":"2024-09-17T04:34:53.177339+0000","last_undegraded":"2024-09-17T04:34:53.177339+0000","last_fullsized":"2024-09-17T04:34:53.177339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:38.029256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:03.114728+0000","last_change":"2024-09-17T04:34:51.071324+0000","last_active":"2024-09-17T04:35:03.114728+0000","last_peered":"2024-09-17T04:35:03.114728+0000","last_clean":"2024-09-17T04:35:03.114728+0000","last_became_active":"2024-09-17T04:34:51.070944+0000","last_became_peered":"2024-09-17T04:34:51.070944+0000","last_unstale":"2024-09-17T04:35:03.114728+0000","last_undegraded":"2024-09-17T04:35:03.114728+0000","last_fullsized":"2024-09-17T04:35:03.114728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:13.931324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.079005+0000","last_change":"2024-09-17T04:34:52.081178+0000","last_active":"2024-09-17T04:34:53.079005+0000","last_peered":"2024-09-17T04:34:53.079005+0000","last_clean":"2024-09-17T04:34:53.079005+0000","last_became_active":"2024-09-17T04:34:52.080855+0000","last_became_peered":"2024-09-17T04:34:52.080855+0000","last_unstale":"2024-09-17T04:34:53.079005+0000","last_undegraded":"2024-09-17T04:34:53.079005+0000","last_fullsized":"2024-09-17T04:34:53.079005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:49.091080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081719+0000","last_change":"2024-09-17T04:34:52.066633+0000","last_active":"2024-09-17T04:34:53.081719+0000","last_peered":"2024-09-17T04:34:53.081719+0000","last_clean":"2024-09-17T04:34:53.081719+0000","last_became_active":"2024-09-17T04:34:52.066263+0000","last_became_peered":"2024-09-17T04:34:52.066263+0000","last_unstale":"2024-09-17T04:34:53.081719+0000","last_undegraded":"2024-09-17T04:34:53.081719+0000","last_fullsized":"2024-09-17T04:34:53.081719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:13.396220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.068696+0000","last_change":"2024-09-17T04:34:51.067927+0000","last_active":"2024-09-17T04:34:57.068696+0000","last_peered":"2024-09-17T04:34:57.068696+0000","last_clean":"2024-09-17T04:34:57.068696+0000","last_became_active":"2024-09-17T04:34:51.067555+0000","last_became_peered":"2024-09-17T04:34:51.067555+0000","last_unstale":"2024-09-17T04:34:57.068696+0000","last_undegraded":"2024-09-17T04:34:57.068696+0000","last_fullsized":"2024-09-17T04:34:57.068696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:33.815585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.081560+0000","last_change":"2024-09-17T04:34:52.074529+0000","last_active":"2024-09-17T04:34:53.081560+0000","last_peered":"2024-09-17T04:34:53.081560+0000","last_clean":"2024-09-17T04:34:53.081560+0000","last_became_active":"2024-09-17T04:34:52.074149+0000","last_became_peered":"2024-09-17T04:34:52.074149+0000","last_unstale":"2024-09-17T04:34:53.081560+0000","last_undegraded":"2024-09-17T04:34:53.081560+0000","last_fullsized":"2024-09-17T04:34:53.081560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:31.679908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.131973+0000","last_change":"2024-09-17T04:34:51.078231+0000","last_active":"2024-09-17T04:35:09.131973+0000","last_peered":"2024-09-17T04:35:09.131973+0000","last_clean":"2024-09-17T04:35:09.131973+0000","last_became_active":"2024-09-17T04:34:51.077872+0000","last_became_peered":"2024-09-17T04:34:51.077872+0000","last_unstale":"2024-09-17T04:35:09.131973+0000","last_undegraded":"2024-09-17T04:35:09.131973+0000","last_fullsized":"2024-09-17T04:35:09.131973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:38.304333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.315510+0000","last_change":"2024-09-17T04:34:52.084955+0000","last_active":"2024-09-17T04:34:53.315510+0000","last_peered":"2024-09-17T04:34:53.315510+0000","last_clean":"2024-09-17T04:34:53.315510+0000","last_became_active":"2024-09-17T04:34:52.084559+0000","last_became_peered":"2024-09-17T04:34:52.084559+0000","last_unstale":"2024-09-17T04:34:53.315510+0000","last_undegraded":"2024-09-17T04:34:53.315510+0000","last_fullsized":"2024-09-17T04:34:53.315510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:28.901357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:57.063980+0000","last_change":"2024-09-17T04:34:51.073959+0000","last_active":"2024-09-17T04:34:57.063980+0000","last_peered":"2024-09-17T04:34:57.063980+0000","last_clean":"2024-09-17T04:34:57.063980+0000","last_became_active":"2024-09-17T04:34:51.073496+0000","last_became_peered":"2024-09-17T04:34:51.073496+0000","last_unstale":"2024-09-17T04:34:57.063980+0000","last_undegraded":"2024-09-17T04:34:57.063980+0000","last_fullsized":"2024-09-17T04:34:57.063980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:23.001571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:34:53.177328+0000","last_change":"2024-09-17T04:34:52.081971+0000","last_active":"2024-09-17T04:34:53.177328+0000","last_peered":"2024-09-17T04:34:53.177328+0000","last_clean":"2024-09-17T04:34:53.177328+0000","last_became_active":"2024-09-17T04:34:52.081259+0000","last_became_peered":"2024-09-17T04:34:52.081259+0000","last_unstale":"2024-09-17T04:34:53.177328+0000","last_undegraded":"2024-09-17T04:34:53.177328+0000","last_fullsized":"2024-09-17T04:34:53.177328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:43.915741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'9","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T04:35:09.134730+0000","last_change":"2024-09-17T04:34:51.070142+0000","last_active":"2024-09-17T04:35:09.134730+0000","last_peered":"2024-09-17T04:35:09.134730+0000","last_clean":"2024-09-17T04:35:09.134730+0000","last_became_active":"2024-09-17T04:34:51.069777+0000","last_became_peered":"2024-09-17T04:34:51.069777+0000","last_unstale":"2024-09-17T04:35:09.134730+0000","last_undegraded":"2024-09-17T04:35:09.134730+0000","last_fullsized":"2024-09-17T04:35:09.134730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:51.718064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5222,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":10444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476747,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":831488,"data_stored":668230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476747,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":78836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476747,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":77924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476747,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":77260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35580,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336260,"statfs":{"total":96636764160,"available":96600330240,"internally_reserved":0,"allocated":241664,"data_stored":78870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":237568,"data_stored":77364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":77490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":827392,"data_stored":667574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:35:19.165 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-09-17T04:35:19.165 DEBUG:tasks.mon_thrash:Yielding 2024-09-17T04:35:19.165 INFO:teuthology.run_tasks:Running task workunit... 2024-09-17T04:35:19.178 INFO:tasks.workunit:Pulling workunits from ref ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:35:19.178 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-17T04:35:19.178 INFO:tasks.workunit:timeout=3h 2024-09-17T04:35:19.178 INFO:tasks.workunit:cleanup=True 2024-09-17T04:35:19.179 DEBUG:teuthology.orchestra.run.smithi043:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-17T04:35:19.179 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:35:19.219 INFO:teuthology.orchestra.run.smithi043.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-17T04:35:19.219 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-17T04:35:19.219 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-09-17T04:35:19.219 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:35:19.219 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-17T04:35:19.219 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-17T04:35:19.220 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-17 04:34:57.055814874 +0000 2024-09-17T04:35:19.220 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-17 04:35:16.749452548 +0000 2024-09-17T04:35:19.220 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-09-17 04:34:57.055814874 +0000 2024-09-17T04:35:19.220 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-17T04:35:19.220 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-17T04:35:19.291 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:35:19.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.320+0000 7fe064f20640 1 -- 172.21.15.43:0/472752706 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0600cd670 msgr2=0x7fe06015b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:19.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.320+0000 7fe064f20640 1 --2- 172.21.15.43:0/472752706 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0600cd670 0x7fe06015b900 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe048009830 tx=0x7fe04802a3f0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.320+0000 7fe064f20640 1 -- 172.21.15.43:0/472752706 shutdown_connections 2024-09-17T04:35:19.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.320+0000 7fe064f20640 1 --2- 172.21.15.43:0/472752706 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0600cd670 0x7fe06015b900 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.320+0000 7fe064f20640 1 --2- 172.21.15.43:0/472752706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0600b4db0 0x7fe0600caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.320+0000 7fe064f20640 1 -- 172.21.15.43:0/472752706 >> 172.21.15.43:0/472752706 conn(0x7fe06006f4e0 msgr2=0x7fe06006f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:19.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.320+0000 7fe064f20640 1 -- 172.21.15.43:0/472752706 shutdown_connections 2024-09-17T04:35:19.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.320+0000 7fe064f20640 1 -- 172.21.15.43:0/472752706 wait complete. 2024-09-17T04:35:19.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.322+0000 7fe064f20640 1 Processor -- start 2024-09-17T04:35:19.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.322+0000 7fe064f20640 1 -- start start 2024-09-17T04:35:19.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.323+0000 7fe064f20640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0600b4db0 0x7fe0600d1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:19.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.323+0000 7fe064f20640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0600cd670 0x7fe0600c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:19.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.323+0000 7fe064f20640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe06015be40 0x7fe06014c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:19.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.323+0000 7fe064f20640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe0600b5ab0 con 0x7fe0600cd670 2024-09-17T04:35:19.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.323+0000 7fe064f20640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe0600b57d0 con 0x7fe0600b4db0 2024-09-17T04:35:19.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.323+0000 7fe064f20640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe0600cb440 con 0x7fe06015be40 2024-09-17T04:35:19.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.323+0000 7fe05dd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0600cd670 0x7fe0600c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:19.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.324+0000 7fe05dd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0600cd670 0x7fe0600c7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37372/0 (socket says 172.21.15.43:37372) 2024-09-17T04:35:19.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.324+0000 7fe05dd9b640 1 -- 172.21.15.43:0/385796726 learned_addr learned my addr 172.21.15.43:0/385796726 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:19.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.324+0000 7fe05ed9d640 1 --2- 172.21.15.43:0/385796726 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe06015be40 0x7fe06014c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:19.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.324+0000 7fe05e59c640 1 --2- 172.21.15.43:0/385796726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0600b4db0 0x7fe0600d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:19.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.324+0000 7fe05dd9b640 1 -- 172.21.15.43:0/385796726 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe06015be40 msgr2=0x7fe06014c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:19.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.324+0000 7fe05dd9b640 1 --2- 172.21.15.43:0/385796726 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe06015be40 0x7fe06014c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.324+0000 7fe05dd9b640 1 -- 172.21.15.43:0/385796726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0600b4db0 msgr2=0x7fe0600d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:19.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.324+0000 7fe05dd9b640 1 --2- 172.21.15.43:0/385796726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0600b4db0 0x7fe0600d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.324+0000 7fe05dd9b640 1 -- 172.21.15.43:0/385796726 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0600c7320 con 0x7fe0600cd670 2024-09-17T04:35:19.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.324+0000 7fe05dd9b640 1 --2- 172.21.15.43:0/385796726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0600cd670 0x7fe0600c7600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe048009950 tx=0x7fe048033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:19.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.324+0000 7fe056ffd640 1 -- 172.21.15.43:0/385796726 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe048031d60 con 0x7fe0600cd670 2024-09-17T04:35:19.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.324+0000 7fe056ffd640 1 -- 172.21.15.43:0/385796726 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe048033e10 con 0x7fe0600cd670 2024-09-17T04:35:19.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.324+0000 7fe064f20640 1 -- 172.21.15.43:0/385796726 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0600d0690 con 0x7fe0600cd670 2024-09-17T04:35:19.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.324+0000 7fe056ffd640 1 -- 172.21.15.43:0/385796726 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe048005260 con 0x7fe0600cd670 2024-09-17T04:35:19.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.324+0000 7fe064f20640 1 -- 172.21.15.43:0/385796726 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0600cf750 con 0x7fe0600cd670 2024-09-17T04:35:19.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.326+0000 7fe064f20640 1 -- 172.21.15.43:0/385796726 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe060159220 con 0x7fe0600cd670 2024-09-17T04:35:19.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.326+0000 7fe056ffd640 1 -- 172.21.15.43:0/385796726 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe048005400 con 0x7fe0600cd670 2024-09-17T04:35:19.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.327+0000 7fe056ffd640 1 --2- 172.21.15.43:0/385796726 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe040078b90 0x7fe04007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:19.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.327+0000 7fe056ffd640 1 -- 172.21.15.43:0/385796726 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe0480bbde0 con 0x7fe0600cd670 2024-09-17T04:35:19.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.327+0000 7fe05e59c640 1 --2- 172.21.15.43:0/385796726 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe040078b90 0x7fe04007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:19.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.328+0000 7fe05e59c640 1 --2- 172.21.15.43:0/385796726 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe040078b90 0x7fe04007b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe058009b10 tx=0x7fe058005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:19.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.332+0000 7fe056ffd640 1 -- 172.21.15.43:0/385796726 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe04803f030 con 0x7fe0600cd670 2024-09-17T04:35:19.337 INFO:tasks.workunit.client.0.smithi043.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-17T04:35:19.461 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:35:19.463 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:35:19.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.605+0000 7fe064f20640 1 -- 172.21.15.43:0/385796726 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0600ca1b0 con 0x7fe0600cd670 2024-09-17T04:35:19.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.605+0000 7fe056ffd640 1 -- 172.21.15.43:0/385796726 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6896 (secure 0 0 0) 0x7fe048083c10 con 0x7fe0600cd670 2024-09-17T04:35:19.606 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:35:19.606 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":13,"btime":"2024-09-17T04:35:09:138823+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/424910095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6835","nonce":424910095},{"type":"v1","addr":"172.21.15.62:6837","nonce":424910095}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6836/882111784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":882111784},{"type":"v1","addr":"172.21.15.62:6836","nonce":882111784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4431,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/47250523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":47250523},{"type":"v1","addr":"172.21.15.43:6834","nonce":47250523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:34:51.443546+0000","modified":"2024-09-17T04:35:09.138815+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4455,"mds_1":4437,"mds_2":4434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4434":{"gid":4434,"name":"c","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6835/3276393888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":3276393888},{"type":"v1","addr":"172.21.15.43:6835","nonce":3276393888}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4437":{"gid":4437,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.43:6837/3935895854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":3935895854},{"type":"v1","addr":"172.21.15.43:6837","nonce":3935895854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4455":{"gid":4455,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6839/3263944095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3263944095},{"type":"v1","addr":"172.21.15.62:6839","nonce":3263944095}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4455,"qdb_cluster":[4434,4437,4455]},"id":1}]} 2024-09-17T04:35:19.606 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 13 2024-09-17T04:35:19.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.608+0000 7fe064f20640 1 -- 172.21.15.43:0/385796726 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe040078b90 msgr2=0x7fe04007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:19.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.608+0000 7fe064f20640 1 --2- 172.21.15.43:0/385796726 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe040078b90 0x7fe04007b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe058009b10 tx=0x7fe058005f90 comp rx=0 tx=0).stop 2024-09-17T04:35:19.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.608+0000 7fe064f20640 1 -- 172.21.15.43:0/385796726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0600cd670 msgr2=0x7fe0600c7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:19.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.608+0000 7fe064f20640 1 --2- 172.21.15.43:0/385796726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0600cd670 0x7fe0600c7600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe048009950 tx=0x7fe048033c20 comp rx=0 tx=0).stop 2024-09-17T04:35:19.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.608+0000 7fe064f20640 1 -- 172.21.15.43:0/385796726 shutdown_connections 2024-09-17T04:35:19.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.608+0000 7fe064f20640 1 --2- 172.21.15.43:0/385796726 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe040078b90 0x7fe04007b0a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.608+0000 7fe064f20640 1 --2- 172.21.15.43:0/385796726 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe06015be40 0x7fe06014c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.608+0000 7fe064f20640 1 --2- 172.21.15.43:0/385796726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0600cd670 0x7fe0600c7600 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.608+0000 7fe064f20640 1 --2- 172.21.15.43:0/385796726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0600b4db0 0x7fe0600d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.608+0000 7fe064f20640 1 -- 172.21.15.43:0/385796726 >> 172.21.15.43:0/385796726 conn(0x7fe06006f4e0 msgr2=0x7fe0600cacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:19.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.608+0000 7fe064f20640 1 -- 172.21.15.43:0/385796726 shutdown_connections 2024-09-17T04:35:19.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.608+0000 7fe064f20640 1 -- 172.21.15.43:0/385796726 wait complete. 2024-09-17T04:35:19.619 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-09-17T04:35:19.619 INFO:tasks.mon_thrash.mon_thrasher:seed: 1726547719, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-09-17T04:35:19.619 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-17T04:35:19.620 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-17T04:35:19.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.735+0000 7fb864a4d640 1 -- 172.21.15.43:0/3613266790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86006e8a0 msgr2=0x7fb860070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:19.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.735+0000 7fb864a4d640 1 --2- 172.21.15.43:0/3613266790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86006e8a0 0x7fb860070100 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb86006a3f0 tx=0x7fb84802a5f0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.735+0000 7fb864a4d640 1 -- 172.21.15.43:0/3613266790 shutdown_connections 2024-09-17T04:35:19.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.735+0000 7fb864a4d640 1 --2- 172.21.15.43:0/3613266790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86006e8a0 0x7fb860070100 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.735+0000 7fb864a4d640 1 --2- 172.21.15.43:0/3613266790 >> v2:172.21.15.62:3300/0 conn(0x7fb860070640 0x7fb8601589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.735+0000 7fb864a4d640 1 --2- 172.21.15.43:0/3613266790 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8600c2f40 0x7fb8601525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.735+0000 7fb864a4d640 1 -- 172.21.15.43:0/3613266790 >> 172.21.15.43:0/3613266790 conn(0x7fb8600738e0 msgr2=0x7fb860073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:19.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.735+0000 7fb864a4d640 1 -- 172.21.15.43:0/3613266790 shutdown_connections 2024-09-17T04:35:19.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.735+0000 7fb864a4d640 1 -- 172.21.15.43:0/3613266790 wait complete. 2024-09-17T04:35:19.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.737+0000 7fb864a4d640 1 Processor -- start 2024-09-17T04:35:19.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.737+0000 7fb864a4d640 1 -- start start 2024-09-17T04:35:19.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.738+0000 7fb864a4d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86006e8a0 0x7fb8601ef330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:19.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.738+0000 7fb864a4d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb860070640 0x7fb8601e0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:19.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.738+0000 7fb864a4d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8600c2f40 0x7fb860146770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:19.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.738+0000 7fb864a4d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb860070c00 con 0x7fb86006e8a0 2024-09-17T04:35:19.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.738+0000 7fb864a4d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb8600c3dd0 con 0x7fb8600c2f40 2024-09-17T04:35:19.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.738+0000 7fb864a4d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb8600b41e0 con 0x7fb860070640 2024-09-17T04:35:19.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.738+0000 7fb85e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86006e8a0 0x7fb8601ef330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:19.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.738+0000 7fb85e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86006e8a0 0x7fb8601ef330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37396/0 (socket says 172.21.15.43:37396) 2024-09-17T04:35:19.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.738+0000 7fb85e59c640 1 -- 172.21.15.43:0/3748059501 learned_addr learned my addr 172.21.15.43:0/3748059501 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:19.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.738+0000 7fb85ed9d640 1 --2- 172.21.15.43:0/3748059501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8600c2f40 0x7fb860146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:19.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.738+0000 7fb85dd9b640 1 --2- 172.21.15.43:0/3748059501 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb860070640 0x7fb8601e0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:19.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.738+0000 7fb85e59c640 1 -- 172.21.15.43:0/3748059501 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb860070640 msgr2=0x7fb8601e0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:19.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.738+0000 7fb85e59c640 1 --2- 172.21.15.43:0/3748059501 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb860070640 0x7fb8601e0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.738+0000 7fb85e59c640 1 -- 172.21.15.43:0/3748059501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8600c2f40 msgr2=0x7fb860146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:19.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.738+0000 7fb85e59c640 1 --2- 172.21.15.43:0/3748059501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8600c2f40 0x7fb860146770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:19.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.738+0000 7fb85e59c640 1 -- 172.21.15.43:0/3748059501 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8601ee8b0 con 0x7fb86006e8a0 2024-09-17T04:35:19.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.738+0000 7fb85ed9d640 1 --2- 172.21.15.43:0/3748059501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8600c2f40 0x7fb860146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:35:19.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.739+0000 7fb85e59c640 1 --2- 172.21.15.43:0/3748059501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86006e8a0 0x7fb8601ef330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb85000ba80 tx=0x7fb85000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:19.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.739+0000 7fb856ffd640 1 -- 172.21.15.43:0/3748059501 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850019070 con 0x7fb86006e8a0 2024-09-17T04:35:19.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.739+0000 7fb856ffd640 1 -- 172.21.15.43:0/3748059501 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb85000cd10 con 0x7fb86006e8a0 2024-09-17T04:35:19.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.739+0000 7fb864a4d640 1 -- 172.21.15.43:0/3748059501 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb86014e040 con 0x7fb86006e8a0 2024-09-17T04:35:19.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.739+0000 7fb856ffd640 1 -- 172.21.15.43:0/3748059501 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8500146a0 con 0x7fb86006e8a0 2024-09-17T04:35:19.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.739+0000 7fb864a4d640 1 -- 172.21.15.43:0/3748059501 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8601e1e00 con 0x7fb86006e8a0 2024-09-17T04:35:19.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.740+0000 7fb864a4d640 1 -- 172.21.15.43:0/3748059501 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb860070100 con 0x7fb86006e8a0 2024-09-17T04:35:19.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.741+0000 7fb856ffd640 1 -- 172.21.15.43:0/3748059501 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb85001c070 con 0x7fb86006e8a0 2024-09-17T04:35:19.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.741+0000 7fb856ffd640 1 --2- 172.21.15.43:0/3748059501 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fb840078bc0 0x7fb84007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:19.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.741+0000 7fb856ffd640 1 -- 172.21.15.43:0/3748059501 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb85009ab00 con 0x7fb86006e8a0 2024-09-17T04:35:19.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.741+0000 7fb85dd9b640 1 --2- 172.21.15.43:0/3748059501 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fb840078bc0 0x7fb84007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:19.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.742+0000 7fb85dd9b640 1 --2- 172.21.15.43:0/3748059501 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fb840078bc0 0x7fb84007b0d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb848033000 tx=0x7fb848004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:19.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:19.746+0000 7fb856ffd640 1 -- 172.21.15.43:0/3748059501 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb8601ee8b0 con 0x7fb86006e8a0 2024-09-17T04:35:20.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.002+0000 7fb864a4d640 1 -- 172.21.15.43:0/3748059501 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb8600c3550 con 0x7fb86006e8a0 2024-09-17T04:35:20.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.002+0000 7fb856ffd640 1 -- 172.21.15.43:0/3748059501 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fb850062f50 con 0x7fb86006e8a0 2024-09-17T04:35:20.002 INFO:teuthology.orchestra.run.smithi043.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":53,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","modified":"2024-09-17T04:33:51.199044Z","created":"2024-09-17T04:33:51.199044Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3301","nonce":0},{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-17T04:35:20.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.004+0000 7fb864a4d640 1 -- 172.21.15.43:0/3748059501 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fb840078bc0 msgr2=0x7fb84007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.004+0000 7fb864a4d640 1 --2- 172.21.15.43:0/3748059501 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fb840078bc0 0x7fb84007b0d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb848033000 tx=0x7fb848004730 comp rx=0 tx=0).stop 2024-09-17T04:35:20.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.004+0000 7fb864a4d640 1 -- 172.21.15.43:0/3748059501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86006e8a0 msgr2=0x7fb8601ef330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.004+0000 7fb864a4d640 1 --2- 172.21.15.43:0/3748059501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86006e8a0 0x7fb8601ef330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb85000ba80 tx=0x7fb85000bf40 comp rx=0 tx=0).stop 2024-09-17T04:35:20.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.004+0000 7fb864a4d640 1 -- 172.21.15.43:0/3748059501 shutdown_connections 2024-09-17T04:35:20.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.004+0000 7fb864a4d640 1 --2- 172.21.15.43:0/3748059501 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fb840078bc0 0x7fb84007b0d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.004+0000 7fb864a4d640 1 --2- 172.21.15.43:0/3748059501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8600c2f40 0x7fb860146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.004+0000 7fb864a4d640 1 --2- 172.21.15.43:0/3748059501 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb860070640 0x7fb8601e0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.004+0000 7fb864a4d640 1 --2- 172.21.15.43:0/3748059501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86006e8a0 0x7fb8601ef330 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.004+0000 7fb864a4d640 1 -- 172.21.15.43:0/3748059501 >> 172.21.15.43:0/3748059501 conn(0x7fb8600738e0 msgr2=0x7fb8601489a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:20.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.005+0000 7fb864a4d640 1 -- 172.21.15.43:0/3748059501 shutdown_connections 2024-09-17T04:35:20.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.005+0000 7fb864a4d640 1 -- 172.21.15.43:0/3748059501 wait complete. 2024-09-17T04:35:20.015 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-17T04:35:20.015 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-17T04:35:20.015 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-17T04:35:20.016 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-17T04:35:20.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.134+0000 7f4a64b52640 1 -- 172.21.15.43:0/1323635830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a4c004020 msgr2=0x7f4a4c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.134+0000 7f4a64b52640 1 --2- 172.21.15.43:0/1323635830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a4c004020 0x7f4a4c004800 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4a600cd880 tx=0x7f4a4c005830 comp rx=0 tx=0).stop 2024-09-17T04:35:20.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.134+0000 7f4a5ed9d640 1 -- 172.21.15.43:0/1323635830 reap_dead start 2024-09-17T04:35:20.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.135+0000 7f4a64b52640 1 -- 172.21.15.43:0/1323635830 shutdown_connections 2024-09-17T04:35:20.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.135+0000 7f4a64b52640 1 -- 172.21.15.43:0/1323635830 >> 172.21.15.43:0/1323635830 conn(0x7f4a6006f460 msgr2=0x7f4a6006f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:20.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.135+0000 7f4a64b52640 1 -- 172.21.15.43:0/1323635830 shutdown_connections 2024-09-17T04:35:20.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.135+0000 7f4a64b52640 1 -- 172.21.15.43:0/1323635830 wait complete. 2024-09-17T04:35:20.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.137+0000 7f4a64b52640 1 Processor -- start 2024-09-17T04:35:20.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.137+0000 7f4a64b52640 1 -- start start 2024-09-17T04:35:20.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.138+0000 7f4a64b52640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a4c004020 0x7f4a601e3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.138+0000 7f4a64b52640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a6014f660 0x7f4a60068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.138+0000 7f4a64b52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a6014fa70 0x7f4a60069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.138+0000 7f4a64b52640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6015bfa0 con 0x7f4a6014f660 2024-09-17T04:35:20.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.138+0000 7f4a64b52640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6015bcc0 con 0x7f4a6014fa70 2024-09-17T04:35:20.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.138+0000 7f4a64b52640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4a6015b970 con 0x7f4a4c004020 2024-09-17T04:35:20.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.138+0000 7f4a5dd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a6014f660 0x7f4a60068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.138+0000 7f4a5dd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a6014f660 0x7f4a60068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37404/0 (socket says 172.21.15.43:37404) 2024-09-17T04:35:20.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.138+0000 7f4a5dd9b640 1 -- 172.21.15.43:0/467218832 learned_addr learned my addr 172.21.15.43:0/467218832 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:20.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.138+0000 7f4a5e59c640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a4c004020 0x7f4a601e3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.138+0000 7f4a5ed9d640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a6014fa70 0x7f4a60069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.138+0000 7f4a5dd9b640 1 -- 172.21.15.43:0/467218832 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a4c004020 msgr2=0x7f4a601e3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.138+0000 7f4a5dd9b640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a4c004020 0x7f4a601e3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.138+0000 7f4a5dd9b640 1 -- 172.21.15.43:0/467218832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a6014fa70 msgr2=0x7f4a60069240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.138+0000 7f4a5dd9b640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a6014fa70 0x7f4a60069240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.138+0000 7f4a5dd9b640 1 -- 172.21.15.43:0/467218832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a601e3880 con 0x7f4a6014f660 2024-09-17T04:35:20.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.139+0000 7f4a5dd9b640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a6014f660 0x7f4a60068d00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009a70 tx=0x7f4a48033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:20.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.139+0000 7f4a56ffd640 1 -- 172.21.15.43:0/467218832 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a48038040 con 0x7f4a6014f660 2024-09-17T04:35:20.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.139+0000 7f4a56ffd640 1 -- 172.21.15.43:0/467218832 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a48033860 con 0x7f4a6014f660 2024-09-17T04:35:20.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.139+0000 7f4a64b52640 1 -- 172.21.15.43:0/467218832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a601e4a60 con 0x7f4a6014f660 2024-09-17T04:35:20.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.139+0000 7f4a56ffd640 1 -- 172.21.15.43:0/467218832 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a48033cb0 con 0x7f4a6014f660 2024-09-17T04:35:20.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.139+0000 7f4a64b52640 1 -- 172.21.15.43:0/467218832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a601f19a0 con 0x7f4a6014f660 2024-09-17T04:35:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.140+0000 7f4a64b52640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a601e2aa0 0x7f4a601586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.140+0000 7f4a64b52640 1 -- 172.21.15.43:0/467218832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4a600b6330 con 0x7f4a601e2aa0 2024-09-17T04:35:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.140+0000 7f4a5e59c640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a601e2aa0 0x7f4a601586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.140+0000 7f4a5e59c640 1 -- 172.21.15.43:0/467218832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a600b4a10 con 0x7f4a601e2aa0 2024-09-17T04:35:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.140+0000 7f4a5e59c640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a601e2aa0 0x7f4a601586a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4a50001db0 tx=0x7f4a50006780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.141+0000 7f4a56ffd640 1 -- 172.21.15.43:0/467218832 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50012db0 con 0x7f4a601e2aa0 2024-09-17T04:35:20.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.141+0000 7f4a56ffd640 1 -- 172.21.15.43:0/467218832 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4a48043020 con 0x7f4a6014f660 2024-09-17T04:35:20.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.141+0000 7f4a56ffd640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4a40078ac0 0x7f4a4007afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.141+0000 7f4a56ffd640 1 -- 172.21.15.43:0/467218832 <== mon.0 v2:172.21.15.43:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4a5001b440 con 0x7f4a601e2aa0 2024-09-17T04:35:20.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.141+0000 7f4a56ffd640 1 -- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a601e2aa0 msgr2=0x7f4a601586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.141+0000 7f4a56ffd640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a601e2aa0 0x7f4a601586a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4a50001db0 tx=0x7f4a50006780 comp rx=0 tx=0).stop 2024-09-17T04:35:20.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.141+0000 7f4a56ffd640 1 -- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a601e2aa0 msgr2=0x7f4a601586a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:35:20.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.141+0000 7f4a56ffd640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a601e2aa0 0x7f4a601586a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.141+0000 7f4a56ffd640 1 -- 172.21.15.43:0/467218832 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4a480baee0 con 0x7f4a6014f660 2024-09-17T04:35:20.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.142+0000 7f4a5ed9d640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4a40078ac0 0x7f4a4007afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.142+0000 7f4a5ed9d640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4a40078ac0 0x7f4a4007afd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4a6008e2c0 tx=0x7f4a58005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:20.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.148+0000 7f4a64b52640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a60158be0 0x7f4a601f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.148+0000 7f4a64b52640 1 -- 172.21.15.43:0/467218832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4a60159980 con 0x7f4a60158be0 2024-09-17T04:35:20.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.148+0000 7f4a5e59c640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a60158be0 0x7f4a601f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.148+0000 7f4a5e59c640 1 -- 172.21.15.43:0/467218832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4a601e4070 con 0x7f4a60158be0 2024-09-17T04:35:20.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.148+0000 7f4a5e59c640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a60158be0 0x7f4a601f50e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4a50006cd0 tx=0x7f4a600cbc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:20.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.149+0000 7f4a56ffd640 1 -- 172.21.15.43:0/467218832 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50020a40 con 0x7f4a60158be0 2024-09-17T04:35:20.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.149+0000 7f4a56ffd640 1 -- 172.21.15.43:0/467218832 <== mon.0 v2:172.21.15.43:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f4a50024070 con 0x7f4a60158be0 2024-09-17T04:35:20.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.149+0000 7f4a56ffd640 1 -- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a60158be0 msgr2=0x7f4a601f50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.149+0000 7f4a56ffd640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a60158be0 0x7f4a601f50e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4a50006cd0 tx=0x7f4a600cbc60 comp rx=0 tx=0).stop 2024-09-17T04:35:20.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.149+0000 7f4a56ffd640 1 -- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a60158be0 msgr2=0x7f4a601f50e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:35:20.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.149+0000 7f4a56ffd640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a60158be0 0x7f4a601f50e0 secure :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4a50006cd0 tx=0x7f4a600cbc60 comp rx=0 tx=0).stop 2024-09-17T04:35:20.150 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-17T04:35:20.150 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "a", 2024-09-17T04:35:20.150 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 0, 2024-09-17T04:35:20.150 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "leader", 2024-09-17T04:35:20.150 INFO:teuthology.orchestra.run.smithi043.stdout: "election_epoch": 4, 2024-09-17T04:35:20.150 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 53890, 2024-09-17T04:35:20.150 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum": [ 2024-09-17T04:35:20.150 INFO:teuthology.orchestra.run.smithi043.stdout: 0, 2024-09-17T04:35:20.150 INFO:teuthology.orchestra.run.smithi043.stdout: 1, 2024-09-17T04:35:20.150 INFO:teuthology.orchestra.run.smithi043.stdout: 2 2024-09-17T04:35:20.150 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.150 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_age": 53, 2024-09-17T04:35:20.151 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:35:20.151 INFO:teuthology.orchestra.run.smithi043.stdout: "required_con": "2450521708007866372", 2024-09-17T04:35:20.151 INFO:teuthology.orchestra.run.smithi043.stdout: "required_mon": [ 2024-09-17T04:35:20.151 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:35:20.151 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:35:20.151 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:35:20.151 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:35:20.151 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:35:20.151 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:35:20.151 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:35:20.151 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:35:20.151 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:35:20.151 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:35:20.151 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:35:20.151 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.152 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_con": "4540719139924082687", 2024-09-17T04:35:20.152 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_mon": [ 2024-09-17T04:35:20.152 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:35:20.152 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:35:20.152 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:35:20.152 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:35:20.152 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:35:20.152 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:35:20.152 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:35:20.152 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:35:20.152 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:35:20.152 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:35:20.152 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:35:20.152 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.153 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.153 INFO:teuthology.orchestra.run.smithi043.stdout: "outside_quorum": [], 2024-09-17T04:35:20.153 INFO:teuthology.orchestra.run.smithi043.stdout: "extra_probe_peers": [], 2024-09-17T04:35:20.153 INFO:teuthology.orchestra.run.smithi043.stdout: "sync_provider": [], 2024-09-17T04:35:20.153 INFO:teuthology.orchestra.run.smithi043.stdout: "monmap": { 2024-09-17T04:35:20.153 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 1, 2024-09-17T04:35:20.153 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "cdef1e3e-07e6-43e6-b635-3ed1bc15d64a", 2024-09-17T04:35:20.153 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:35:20.153 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:35:20.153 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release": 19, 2024-09-17T04:35:20.153 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release_name": "squid", 2024-09-17T04:35:20.153 INFO:teuthology.orchestra.run.smithi043.stdout: "election_strategy": 1, 2024-09-17T04:35:20.153 INFO:teuthology.orchestra.run.smithi043.stdout: "disallowed_leaders: ": "", 2024-09-17T04:35:20.154 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false, 2024-09-17T04:35:20.154 INFO:teuthology.orchestra.run.smithi043.stdout: "tiebreaker_mon": "", 2024-09-17T04:35:20.154 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_ranks: ": "", 2024-09-17T04:35:20.154 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:35:20.154 INFO:teuthology.orchestra.run.smithi043.stdout: "persistent": [ 2024-09-17T04:35:20.154 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:35:20.154 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:35:20.154 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:35:20.154 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:35:20.154 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:35:20.154 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:35:20.154 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:35:20.155 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:35:20.155 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:35:20.155 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:35:20.155 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:35:20.155 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.155 INFO:teuthology.orchestra.run.smithi043.stdout: "optional": [] 2024-09-17T04:35:20.155 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.155 INFO:teuthology.orchestra.run.smithi043.stdout: "mons": [ 2024-09-17T04:35:20.156 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.156 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 0, 2024-09-17T04:35:20.156 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "a", 2024-09-17T04:35:20.156 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:35:20.156 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:35:20.156 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.156 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:35:20.156 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:3300", 2024-09-17T04:35:20.156 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.156 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.157 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.157 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:35:20.157 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789", 2024-09-17T04:35:20.157 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.157 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.157 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.157 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.157 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789/0", 2024-09-17T04:35:20.157 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.43:6789/0", 2024-09-17T04:35:20.158 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:35:20.158 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:35:20.158 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:35:20.158 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.158 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.158 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 1, 2024-09-17T04:35:20.158 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "b", 2024-09-17T04:35:20.158 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:35:20.158 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:35:20.158 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.158 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:35:20.158 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3300", 2024-09-17T04:35:20.158 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.158 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:35:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789", 2024-09-17T04:35:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789/0", 2024-09-17T04:35:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6789/0", 2024-09-17T04:35:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:35:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:35:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:35:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 2, 2024-09-17T04:35:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "c", 2024-09-17T04:35:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:35:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:35:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:35:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3301", 2024-09-17T04:35:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:35:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790", 2024-09-17T04:35:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790/0", 2024-09-17T04:35:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6790/0", 2024-09-17T04:35:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:35:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:35:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:35:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: "feature_map": { 2024-09-17T04:35:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": [ 2024-09-17T04:35:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:35:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": [ 2024-09-17T04:35:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 4 2024-09-17T04:35:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": [ 2024-09-17T04:35:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 5 2024-09-17T04:35:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: "client": [ 2024-09-17T04:35:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 2 2024-09-17T04:35:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.164 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.164 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false 2024-09-17T04:35:20.164 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-17T04:35:20.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.149+0000 7f4a64b52640 1 -- 172.21.15.43:0/467218832 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4a40078ac0 msgr2=0x7f4a4007afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.149+0000 7f4a64b52640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4a40078ac0 0x7f4a4007afd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4a6008e2c0 tx=0x7f4a58005f90 comp rx=0 tx=0).stop 2024-09-17T04:35:20.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.149+0000 7f4a64b52640 1 -- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a6014f660 msgr2=0x7f4a60068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.149+0000 7f4a64b52640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a6014f660 0x7f4a60068d00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009a70 tx=0x7f4a48033670 comp rx=0 tx=0).stop 2024-09-17T04:35:20.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.149+0000 7f4a5ed9d640 1 -- 172.21.15.43:0/467218832 reap_dead start 2024-09-17T04:35:20.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.149+0000 7f4a64b52640 1 -- 172.21.15.43:0/467218832 shutdown_connections 2024-09-17T04:35:20.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.149+0000 7f4a64b52640 1 --2- 172.21.15.43:0/467218832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a6014f660 0x7f4a60068d00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.149+0000 7f4a64b52640 1 -- 172.21.15.43:0/467218832 >> 172.21.15.43:0/467218832 conn(0x7f4a6006f460 msgr2=0x7f4a60151b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:20.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.149+0000 7f4a64b52640 1 -- 172.21.15.43:0/467218832 shutdown_connections 2024-09-17T04:35:20.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.149+0000 7f4a64b52640 1 -- 172.21.15.43:0/467218832 wait complete. 2024-09-17T04:35:20.166 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-17T04:35:20.166 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-17T04:35:20.166 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-17T04:35:20.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.283+0000 7f432287e640 1 -- 172.21.15.43:0/1981349242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c0cb490 msgr2=0x7f431c0c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.283+0000 7f432287e640 1 --2- 172.21.15.43:0/1981349242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c0cb490 0x7f431c0c5d90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f430c009830 tx=0x7f430c02a5a0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.284+0000 7f432287e640 1 -- 172.21.15.43:0/1981349242 shutdown_connections 2024-09-17T04:35:20.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.284+0000 7f432287e640 1 --2- 172.21.15.43:0/1981349242 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f431c0ca590 0x7f431c0ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.284+0000 7f432287e640 1 --2- 172.21.15.43:0/1981349242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c0cb490 0x7f431c0c5d90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.284+0000 7f432287e640 1 -- 172.21.15.43:0/1981349242 >> 172.21.15.43:0/1981349242 conn(0x7f431c0cefa0 msgr2=0x7f431c0cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:20.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.284+0000 7f432287e640 1 -- 172.21.15.43:0/1981349242 shutdown_connections 2024-09-17T04:35:20.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.284+0000 7f432287e640 1 -- 172.21.15.43:0/1981349242 wait complete. 2024-09-17T04:35:20.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.285+0000 7f432287e640 1 Processor -- start 2024-09-17T04:35:20.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.285+0000 7f432287e640 1 -- start start 2024-09-17T04:35:20.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.287+0000 7f432287e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c0ca590 0x7f431c1f0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.287+0000 7f432287e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c0cb490 0x7f431c1e5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.287+0000 7f432287e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f431c1538e0 0x7f431c1e5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.287+0000 7f432287e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f431c071e00 con 0x7f431c0ca590 2024-09-17T04:35:20.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.287+0000 7f432287e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f431c0caee0 con 0x7f431c0cb490 2024-09-17T04:35:20.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.287+0000 7f432287e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f431c153cf0 con 0x7f431c1538e0 2024-09-17T04:35:20.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.287+0000 7f431bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c0ca590 0x7f431c1f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.287+0000 7f431bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c0ca590 0x7f431c1f0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34312/0 (socket says 172.21.15.43:34312) 2024-09-17T04:35:20.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.287+0000 7f431bfff640 1 -- 172.21.15.43:0/151690341 learned_addr learned my addr 172.21.15.43:0/151690341 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:20.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.287+0000 7f431b7fe640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c0cb490 0x7f431c1e5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.287+0000 7f4320e1b640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f431c1538e0 0x7f431c1e5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.287+0000 7f431bfff640 1 -- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f431c1538e0 msgr2=0x7f431c1e5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.287+0000 7f431bfff640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f431c1538e0 0x7f431c1e5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.287+0000 7f431bfff640 1 -- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c0cb490 msgr2=0x7f431c1e5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.287+0000 7f431bfff640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c0cb490 0x7f431c1e5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.287+0000 7f431bfff640 1 -- 172.21.15.43:0/151690341 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431c157d70 con 0x7f431c0ca590 2024-09-17T04:35:20.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.287+0000 7f431bfff640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c0ca590 0x7f431c1f0300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f430c009950 tx=0x7f430c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:20.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.288+0000 7f4318ff9640 1 -- 172.21.15.43:0/151690341 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c031d60 con 0x7f431c0ca590 2024-09-17T04:35:20.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.288+0000 7f4318ff9640 1 -- 172.21.15.43:0/151690341 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f430c033e10 con 0x7f431c0ca590 2024-09-17T04:35:20.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.288+0000 7f432287e640 1 -- 172.21.15.43:0/151690341 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f431c1f0840 con 0x7f431c0ca590 2024-09-17T04:35:20.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.288+0000 7f4318ff9640 1 -- 172.21.15.43:0/151690341 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c005260 con 0x7f431c0ca590 2024-09-17T04:35:20.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.288+0000 7f432287e640 1 -- 172.21.15.43:0/151690341 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f431c14f760 con 0x7f431c0ca590 2024-09-17T04:35:20.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.288+0000 7f432287e640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c1efd00 0x7f431c0ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.288+0000 7f432287e640 1 -- 172.21.15.43:0/151690341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f431c0ce9e0 con 0x7f431c1efd00 2024-09-17T04:35:20.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.289+0000 7f431b7fe640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c1efd00 0x7f431c0ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.289+0000 7f431b7fe640 1 -- 172.21.15.43:0/151690341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f431c1f0a10 con 0x7f431c1efd00 2024-09-17T04:35:20.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.289+0000 7f431b7fe640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c1efd00 0x7f431c0ccf80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f431c0770a0 tx=0x7f431000e820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:20.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.289+0000 7f4318ff9640 1 -- 172.21.15.43:0/151690341 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f430c005400 con 0x7f431c0ca590 2024-09-17T04:35:20.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.290+0000 7f4318ff9640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4308078bc0 0x7f430807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.290+0000 7f4318ff9640 1 -- 172.21.15.43:0/151690341 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f430c0bbe50 con 0x7f431c0ca590 2024-09-17T04:35:20.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.290+0000 7f4320e1b640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4308078bc0 0x7f430807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.290+0000 7f4318ff9640 1 -- 172.21.15.43:0/151690341 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310005020 con 0x7f431c1efd00 2024-09-17T04:35:20.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.290+0000 7f4318ff9640 1 -- 172.21.15.43:0/151690341 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f43100051c0 con 0x7f431c1efd00 2024-09-17T04:35:20.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.290+0000 7f4318ff9640 1 -- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c1efd00 msgr2=0x7f431c0ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.290+0000 7f4318ff9640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c1efd00 0x7f431c0ccf80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f431c0770a0 tx=0x7f431000e820 comp rx=0 tx=0).stop 2024-09-17T04:35:20.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.290+0000 7f4318ff9640 1 -- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c1efd00 msgr2=0x7f431c0ccf80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:35:20.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.290+0000 7f4318ff9640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c1efd00 0x7f431c0ccf80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.291+0000 7f4320e1b640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4308078bc0 0x7f430807b0d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4314005fd0 tx=0x7f4314009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:20.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.296+0000 7f432287e640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c0cd4c0 0x7f431c1f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.296+0000 7f432287e640 1 -- 172.21.15.43:0/151690341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f431c0cec30 con 0x7f431c0cd4c0 2024-09-17T04:35:20.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.297+0000 7f431b7fe640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c0cd4c0 0x7f431c1f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.297+0000 7f431b7fe640 1 -- 172.21.15.43:0/151690341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f431c14d7c0 con 0x7f431c0cd4c0 2024-09-17T04:35:20.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.297+0000 7f431b7fe640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c0cd4c0 0x7f431c1f3110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f431c0770a0 tx=0x7f4310000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:20.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.297+0000 7f4318ff9640 1 -- 172.21.15.43:0/151690341 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310013b40 con 0x7f431c0cd4c0 2024-09-17T04:35:20.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.298+0000 7f4318ff9640 1 -- 172.21.15.43:0/151690341 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4874 (secure 0 0 0) 0x7f4310013b40 con 0x7f431c0cd4c0 2024-09-17T04:35:20.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.298+0000 7f4318ff9640 1 -- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c0cd4c0 msgr2=0x7f431c1f3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.298+0000 7f4318ff9640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c0cd4c0 0x7f431c1f3110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f431c0770a0 tx=0x7f4310000ed0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.298+0000 7f4318ff9640 1 -- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c0cd4c0 msgr2=0x7f431c1f3110 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:35:20.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.298+0000 7f4318ff9640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c0cd4c0 0x7f431c1f3110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.298 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-17T04:35:20.299 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "b", 2024-09-17T04:35:20.299 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 1, 2024-09-17T04:35:20.299 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "peon", 2024-09-17T04:35:20.299 INFO:teuthology.orchestra.run.smithi043.stdout: "election_epoch": 4, 2024-09-17T04:35:20.299 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 54002, 2024-09-17T04:35:20.299 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum": [ 2024-09-17T04:35:20.299 INFO:teuthology.orchestra.run.smithi043.stdout: 0, 2024-09-17T04:35:20.299 INFO:teuthology.orchestra.run.smithi043.stdout: 1, 2024-09-17T04:35:20.299 INFO:teuthology.orchestra.run.smithi043.stdout: 2 2024-09-17T04:35:20.299 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.299 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_age": 53, 2024-09-17T04:35:20.299 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:35:20.299 INFO:teuthology.orchestra.run.smithi043.stdout: "required_con": "2450521708007866372", 2024-09-17T04:35:20.300 INFO:teuthology.orchestra.run.smithi043.stdout: "required_mon": [ 2024-09-17T04:35:20.300 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:35:20.300 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:35:20.300 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:35:20.300 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:35:20.300 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:35:20.300 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:35:20.300 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:35:20.300 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:35:20.300 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:35:20.300 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:35:20.300 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:35:20.300 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.300 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_con": "4540719139924082687", 2024-09-17T04:35:20.301 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_mon": [ 2024-09-17T04:35:20.301 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:35:20.301 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:35:20.301 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:35:20.301 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:35:20.301 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:35:20.301 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:35:20.301 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:35:20.301 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:35:20.301 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:35:20.301 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:35:20.301 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:35:20.301 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.301 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.302 INFO:teuthology.orchestra.run.smithi043.stdout: "outside_quorum": [], 2024-09-17T04:35:20.302 INFO:teuthology.orchestra.run.smithi043.stdout: "extra_probe_peers": [], 2024-09-17T04:35:20.302 INFO:teuthology.orchestra.run.smithi043.stdout: "sync_provider": [], 2024-09-17T04:35:20.302 INFO:teuthology.orchestra.run.smithi043.stdout: "monmap": { 2024-09-17T04:35:20.302 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 1, 2024-09-17T04:35:20.302 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "cdef1e3e-07e6-43e6-b635-3ed1bc15d64a", 2024-09-17T04:35:20.302 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:35:20.302 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:35:20.302 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release": 19, 2024-09-17T04:35:20.302 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release_name": "squid", 2024-09-17T04:35:20.302 INFO:teuthology.orchestra.run.smithi043.stdout: "election_strategy": 1, 2024-09-17T04:35:20.302 INFO:teuthology.orchestra.run.smithi043.stdout: "disallowed_leaders: ": "", 2024-09-17T04:35:20.302 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false, 2024-09-17T04:35:20.302 INFO:teuthology.orchestra.run.smithi043.stdout: "tiebreaker_mon": "", 2024-09-17T04:35:20.303 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_ranks: ": "", 2024-09-17T04:35:20.303 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:35:20.303 INFO:teuthology.orchestra.run.smithi043.stdout: "persistent": [ 2024-09-17T04:35:20.303 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:35:20.303 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:35:20.303 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:35:20.303 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:35:20.303 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:35:20.303 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:35:20.303 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:35:20.303 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:35:20.303 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:35:20.303 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:35:20.304 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:35:20.304 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.304 INFO:teuthology.orchestra.run.smithi043.stdout: "optional": [] 2024-09-17T04:35:20.304 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.304 INFO:teuthology.orchestra.run.smithi043.stdout: "mons": [ 2024-09-17T04:35:20.304 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.304 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 0, 2024-09-17T04:35:20.304 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "a", 2024-09-17T04:35:20.304 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:35:20.304 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:35:20.304 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.304 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:35:20.304 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:3300", 2024-09-17T04:35:20.305 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.305 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.305 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.305 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:35:20.305 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789", 2024-09-17T04:35:20.305 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.305 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.305 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.305 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.305 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789/0", 2024-09-17T04:35:20.305 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.43:6789/0", 2024-09-17T04:35:20.305 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:35:20.305 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:35:20.306 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:35:20.306 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.306 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.306 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 1, 2024-09-17T04:35:20.306 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "b", 2024-09-17T04:35:20.306 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:35:20.306 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:35:20.306 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.306 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:35:20.306 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3300", 2024-09-17T04:35:20.306 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.306 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.306 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.306 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:35:20.307 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789", 2024-09-17T04:35:20.307 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.307 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.307 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.307 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.307 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789/0", 2024-09-17T04:35:20.307 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6789/0", 2024-09-17T04:35:20.307 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:35:20.307 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:35:20.307 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:35:20.307 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.307 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.307 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 2, 2024-09-17T04:35:20.307 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "c", 2024-09-17T04:35:20.308 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:35:20.308 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:35:20.308 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.308 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:35:20.308 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3301", 2024-09-17T04:35:20.308 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.308 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.308 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.308 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:35:20.308 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790", 2024-09-17T04:35:20.308 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.308 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.308 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.309 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.309 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790/0", 2024-09-17T04:35:20.309 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6790/0", 2024-09-17T04:35:20.309 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:35:20.309 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:35:20.309 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:35:20.309 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.309 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.309 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.309 INFO:teuthology.orchestra.run.smithi043.stdout: "feature_map": { 2024-09-17T04:35:20.309 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": [ 2024-09-17T04:35:20.309 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.309 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:20.310 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:20.310 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:35:20.310 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.310 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.310 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": [ 2024-09-17T04:35:20.310 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.310 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:20.310 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:20.310 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 2 2024-09-17T04:35:20.310 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.310 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.310 INFO:teuthology.orchestra.run.smithi043.stdout: "client": [ 2024-09-17T04:35:20.310 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.310 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:20.310 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:20.311 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 5 2024-09-17T04:35:20.311 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.311 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.311 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": [ 2024-09-17T04:35:20.311 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.311 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:20.311 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:20.311 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:35:20.311 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.311 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.311 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.311 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false 2024-09-17T04:35:20.311 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-17T04:35:20.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.298+0000 7f432287e640 1 -- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4308078bc0 msgr2=0x7f430807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.298+0000 7f432287e640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f4308078bc0 0x7f430807b0d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4314005fd0 tx=0x7f4314009500 comp rx=0 tx=0).stop 2024-09-17T04:35:20.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.298+0000 7f432287e640 1 -- 172.21.15.43:0/151690341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c0ca590 msgr2=0x7f431c1f0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.298+0000 7f432287e640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c0ca590 0x7f431c1f0300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f430c009950 tx=0x7f430c033c20 comp rx=0 tx=0).stop 2024-09-17T04:35:20.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.298+0000 7f4320e1b640 1 -- 172.21.15.43:0/151690341 reap_dead start 2024-09-17T04:35:20.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.298+0000 7f432287e640 1 -- 172.21.15.43:0/151690341 shutdown_connections 2024-09-17T04:35:20.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.298+0000 7f432287e640 1 --2- 172.21.15.43:0/151690341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c0ca590 0x7f431c1f0300 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.298+0000 7f432287e640 1 -- 172.21.15.43:0/151690341 >> 172.21.15.43:0/151690341 conn(0x7f431c0cefa0 msgr2=0x7f431c1489f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:20.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.298+0000 7f432287e640 1 -- 172.21.15.43:0/151690341 shutdown_connections 2024-09-17T04:35:20.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.298+0000 7f432287e640 1 -- 172.21.15.43:0/151690341 wait complete. 2024-09-17T04:35:20.314 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-17T04:35:20.314 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-17T04:35:20.314 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-17T04:35:20.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.431+0000 7ff13a590640 1 -- 172.21.15.43:0/3806713961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff134155d40 msgr2=0x7ff13415eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.431+0000 7ff13a590640 1 --2- 172.21.15.43:0/3806713961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff134155d40 0x7ff13415eef0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff1340cef00 tx=0x7ff12802a530 comp rx=0 tx=0).stop 2024-09-17T04:35:20.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.431+0000 7ff13a590640 1 -- 172.21.15.43:0/3806713961 shutdown_connections 2024-09-17T04:35:20.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.431+0000 7ff13a590640 1 --2- 172.21.15.43:0/3806713961 >> v2:172.21.15.62:3300/0 conn(0x7ff1340c69b0 0x7ff13415f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.431+0000 7ff13a590640 1 --2- 172.21.15.43:0/3806713961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff134155d40 0x7ff13415eef0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.431+0000 7ff13a590640 1 -- 172.21.15.43:0/3806713961 >> 172.21.15.43:0/3806713961 conn(0x7ff13406f460 msgr2=0x7ff13406f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:20.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.431+0000 7ff13a590640 1 -- 172.21.15.43:0/3806713961 shutdown_connections 2024-09-17T04:35:20.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.431+0000 7ff13a590640 1 -- 172.21.15.43:0/3806713961 wait complete. 2024-09-17T04:35:20.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.433+0000 7ff13a590640 1 Processor -- start 2024-09-17T04:35:20.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.433+0000 7ff13a590640 1 -- start start 2024-09-17T04:35:20.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.434+0000 7ff13a590640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1340c69b0 0x7ff1341f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.434+0000 7ff13a590640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1340c6f00 0x7ff1340d05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.434+0000 7ff13a590640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff134155d40 0x7ff1341597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.434+0000 7ff13a590640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff1340c7730 con 0x7ff1340c6f00 2024-09-17T04:35:20.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.434+0000 7ff13a590640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff1340c7450 con 0x7ff134155d40 2024-09-17T04:35:20.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.434+0000 7ff13a590640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff1340b4d50 con 0x7ff1340c69b0 2024-09-17T04:35:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.434+0000 7ff1337fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1340c6f00 0x7ff1340d05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.434+0000 7ff1337fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1340c6f00 0x7ff1340d05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34328/0 (socket says 172.21.15.43:34328) 2024-09-17T04:35:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.434+0000 7ff1337fe640 1 -- 172.21.15.43:0/2353707123 learned_addr learned my addr 172.21.15.43:0/2353707123 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.434+0000 7ff138b2d640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff134155d40 0x7ff1341597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.434+0000 7ff133fff640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1340c69b0 0x7ff1341f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.435+0000 7ff1337fe640 1 -- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1340c69b0 msgr2=0x7ff1341f1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.435+0000 7ff1337fe640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1340c69b0 0x7ff1341f1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.435+0000 7ff1337fe640 1 -- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff134155d40 msgr2=0x7ff1341597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.435+0000 7ff1337fe640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff134155d40 0x7ff1341597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.435+0000 7ff1337fe640 1 -- 172.21.15.43:0/2353707123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1341f2320 con 0x7ff1340c6f00 2024-09-17T04:35:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.435+0000 7ff133fff640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1340c69b0 0x7ff1341f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:35:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.435+0000 7ff1337fe640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1340c6f00 0x7ff1340d05c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff128009920 tx=0x7ff128033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:20.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.435+0000 7ff130ff9640 1 -- 172.21.15.43:0/2353707123 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128031d60 con 0x7ff1340c6f00 2024-09-17T04:35:20.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.435+0000 7ff130ff9640 1 -- 172.21.15.43:0/2353707123 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff128033e10 con 0x7ff1340c6f00 2024-09-17T04:35:20.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.435+0000 7ff13a590640 1 -- 172.21.15.43:0/2353707123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1340cac30 con 0x7ff1340c6f00 2024-09-17T04:35:20.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.435+0000 7ff130ff9640 1 -- 172.21.15.43:0/2353707123 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128005260 con 0x7ff1340c6f00 2024-09-17T04:35:20.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.435+0000 7ff13a590640 1 -- 172.21.15.43:0/2353707123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1340cb1f0 con 0x7ff1340c6f00 2024-09-17T04:35:20.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.436+0000 7ff13a590640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff13414ffe0 0x7ff134159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.436+0000 7ff13a590640 1 -- 172.21.15.43:0/2353707123 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff1341f27f0 con 0x7ff13414ffe0 2024-09-17T04:35:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.436+0000 7ff133fff640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff13414ffe0 0x7ff134159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.437+0000 7ff133fff640 1 -- 172.21.15.43:0/2353707123 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1340ca9e0 con 0x7ff13414ffe0 2024-09-17T04:35:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.437+0000 7ff133fff640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff13414ffe0 0x7ff134159d00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff124001eb0 tx=0x7ff12400e960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.437+0000 7ff130ff9640 1 -- 172.21.15.43:0/2353707123 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124005020 con 0x7ff13414ffe0 2024-09-17T04:35:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.437+0000 7ff130ff9640 1 -- 172.21.15.43:0/2353707123 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff128005400 con 0x7ff1340c6f00 2024-09-17T04:35:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.438+0000 7ff130ff9640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7ff120078a90 0x7ff12007afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.438+0000 7ff130ff9640 1 -- 172.21.15.43:0/2353707123 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff1280bbdf0 con 0x7ff1340c6f00 2024-09-17T04:35:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.438+0000 7ff138b2d640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7ff120078a90 0x7ff12007afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.438+0000 7ff130ff9640 1 -- 172.21.15.43:0/2353707123 <== mon.2 v2:172.21.15.62:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff1240051c0 con 0x7ff13414ffe0 2024-09-17T04:35:20.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.438+0000 7ff130ff9640 1 -- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff13414ffe0 msgr2=0x7ff134159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.438+0000 7ff130ff9640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff13414ffe0 0x7ff134159d00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff124001eb0 tx=0x7ff12400e960 comp rx=0 tx=0).stop 2024-09-17T04:35:20.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.438+0000 7ff130ff9640 1 -- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff13414ffe0 msgr2=0x7ff134159d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:35:20.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.438+0000 7ff130ff9640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff13414ffe0 0x7ff134159d00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.438+0000 7ff138b2d640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7ff120078a90 0x7ff12007afa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff12c005fd0 tx=0x7ff12c009560 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:20.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.444+0000 7ff13a590640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff13415a240 0x7ff13414b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.444+0000 7ff13a590640 1 -- 172.21.15.43:0/2353707123 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff1341f5ce0 con 0x7ff13415a240 2024-09-17T04:35:20.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.444+0000 7ff133fff640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff13415a240 0x7ff13414b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.445+0000 7ff133fff640 1 -- 172.21.15.43:0/2353707123 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff13415a650 con 0x7ff13415a240 2024-09-17T04:35:20.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.445+0000 7ff133fff640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff13415a240 0x7ff13414b4d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff124001eb0 tx=0x7ff124004620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:20.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.445+0000 7ff130ff9640 1 -- 172.21.15.43:0/2353707123 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124004c20 con 0x7ff13415a240 2024-09-17T04:35:20.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.445+0000 7ff130ff9640 1 -- 172.21.15.43:0/2353707123 <== mon.2 v2:172.21.15.62:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5184 (secure 0 0 0) 0x7ff124004c20 con 0x7ff13415a240 2024-09-17T04:35:20.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.445+0000 7ff130ff9640 1 -- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff13415a240 msgr2=0x7ff13414b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.446+0000 7ff130ff9640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff13415a240 0x7ff13414b4d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff124001eb0 tx=0x7ff124004620 comp rx=0 tx=0).stop 2024-09-17T04:35:20.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.446+0000 7ff130ff9640 1 -- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff13415a240 msgr2=0x7ff13414b4d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:35:20.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.446+0000 7ff130ff9640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff13415a240 0x7ff13414b4d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.446 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-17T04:35:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "c", 2024-09-17T04:35:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 2, 2024-09-17T04:35:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "peon", 2024-09-17T04:35:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "election_epoch": 4, 2024-09-17T04:35:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 54149, 2024-09-17T04:35:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum": [ 2024-09-17T04:35:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: 0, 2024-09-17T04:35:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: 1, 2024-09-17T04:35:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: 2 2024-09-17T04:35:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_age": 53, 2024-09-17T04:35:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:35:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "required_con": "2450521708007866372", 2024-09-17T04:35:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "required_mon": [ 2024-09-17T04:35:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:35:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:35:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:35:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:35:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:35:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:35:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:35:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:35:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:35:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:35:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:35:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_con": "4540719139924082687", 2024-09-17T04:35:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_mon": [ 2024-09-17T04:35:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:35:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:35:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:35:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:35:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:35:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:35:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:35:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:35:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:35:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:35:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:35:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "outside_quorum": [], 2024-09-17T04:35:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "extra_probe_peers": [], 2024-09-17T04:35:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "sync_provider": [], 2024-09-17T04:35:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "monmap": { 2024-09-17T04:35:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 1, 2024-09-17T04:35:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "cdef1e3e-07e6-43e6-b635-3ed1bc15d64a", 2024-09-17T04:35:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:35:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:35:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release": 19, 2024-09-17T04:35:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release_name": "squid", 2024-09-17T04:35:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "election_strategy": 1, 2024-09-17T04:35:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "disallowed_leaders: ": "", 2024-09-17T04:35:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false, 2024-09-17T04:35:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "tiebreaker_mon": "", 2024-09-17T04:35:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_ranks: ": "", 2024-09-17T04:35:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:35:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "persistent": [ 2024-09-17T04:35:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:35:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:35:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:35:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:35:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:35:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:35:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:35:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:35:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:35:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:35:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:35:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "optional": [] 2024-09-17T04:35:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "mons": [ 2024-09-17T04:35:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 0, 2024-09-17T04:35:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "a", 2024-09-17T04:35:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:35:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:35:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:35:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:3300", 2024-09-17T04:35:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:35:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789", 2024-09-17T04:35:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789/0", 2024-09-17T04:35:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.43:6789/0", 2024-09-17T04:35:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:35:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:35:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:35:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 1, 2024-09-17T04:35:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "b", 2024-09-17T04:35:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:35:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:35:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:35:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3300", 2024-09-17T04:35:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:35:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789", 2024-09-17T04:35:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789/0", 2024-09-17T04:35:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6789/0", 2024-09-17T04:35:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:35:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:35:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:35:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 2, 2024-09-17T04:35:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "c", 2024-09-17T04:35:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:35:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:35:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:35:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3301", 2024-09-17T04:35:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.458 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:35:20.458 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790", 2024-09-17T04:35:20.458 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:20.458 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.458 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.458 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.458 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790/0", 2024-09-17T04:35:20.458 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6790/0", 2024-09-17T04:35:20.459 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:35:20.459 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:35:20.459 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:35:20.459 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.459 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.459 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.459 INFO:teuthology.orchestra.run.smithi043.stdout: "feature_map": { 2024-09-17T04:35:20.459 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": [ 2024-09-17T04:35:20.459 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.459 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:20.459 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:20.459 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:35:20.460 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.460 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.460 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": [ 2024-09-17T04:35:20.460 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.460 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:20.460 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:20.460 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 2 2024-09-17T04:35:20.460 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.460 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.460 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": [ 2024-09-17T04:35:20.460 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.460 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:20.461 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:20.461 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:35:20.461 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.461 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.461 INFO:teuthology.orchestra.run.smithi043.stdout: "client": [ 2024-09-17T04:35:20.461 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.461 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-17T04:35:20.461 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "luminous", 2024-09-17T04:35:20.461 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:35:20.461 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.461 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.461 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:20.461 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:20.461 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:35:20.462 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.462 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:20.462 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": [ 2024-09-17T04:35:20.462 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:20.462 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:20.462 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:20.462 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:35:20.462 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:20.462 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:20.462 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:20.462 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false 2024-09-17T04:35:20.462 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-17T04:35:20.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.446+0000 7ff13a590640 1 -- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7ff120078a90 msgr2=0x7ff12007afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.446+0000 7ff13a590640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7ff120078a90 0x7ff12007afa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff12c005fd0 tx=0x7ff12c009560 comp rx=0 tx=0).stop 2024-09-17T04:35:20.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.446+0000 7ff13a590640 1 -- 172.21.15.43:0/2353707123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1340c6f00 msgr2=0x7ff1340d05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.446+0000 7ff13a590640 1 --2- 172.21.15.43:0/2353707123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1340c6f00 0x7ff1340d05c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff128009920 tx=0x7ff128033c20 comp rx=0 tx=0).stop 2024-09-17T04:35:20.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.446+0000 7ff138b2d640 1 -- 172.21.15.43:0/2353707123 reap_dead start 2024-09-17T04:35:20.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.446+0000 7ff138b2d640 1 -- 172.21.15.43:0/2353707123 reap_dead start 2024-09-17T04:35:20.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.446+0000 7ff13a590640 1 -- 172.21.15.43:0/2353707123 shutdown_connections 2024-09-17T04:35:20.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.446+0000 7ff13a590640 1 -- 172.21.15.43:0/2353707123 >> 172.21.15.43:0/2353707123 conn(0x7ff13406f460 msgr2=0x7ff13415ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:20.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.446+0000 7ff13a590640 1 -- 172.21.15.43:0/2353707123 shutdown_connections 2024-09-17T04:35:20.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.446+0000 7ff13a590640 1 -- 172.21.15.43:0/2353707123 wait complete. 2024-09-17T04:35:20.465 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-17T04:35:20.465 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-17T04:35:20.465 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-17T04:35:20.465 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-17T04:35:20.465 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-17T04:35:20.466 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T04:35:20.466 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:35:20.480 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T04:35:20.480 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-17T04:35:20.480 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-17T04:35:20.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.596+0000 7f7421870640 1 -- 172.21.15.43:0/1074045356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74080039b0 msgr2=0x7f7408003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.596+0000 7f7421870640 1 --2- 172.21.15.43:0/1074045356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74080039b0 0x7f7408003e20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f740c00c310 tx=0x7f7408005830 comp rx=0 tx=0).stop 2024-09-17T04:35:20.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.596+0000 7f741b7fe640 1 -- 172.21.15.43:0/1074045356 reap_dead start 2024-09-17T04:35:20.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.596+0000 7f7421870640 1 -- 172.21.15.43:0/1074045356 shutdown_connections 2024-09-17T04:35:20.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.596+0000 7f7421870640 1 -- 172.21.15.43:0/1074045356 >> 172.21.15.43:0/1074045356 conn(0x7f741c06f4e0 msgr2=0x7f741c06f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:20.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.596+0000 7f7421870640 1 -- 172.21.15.43:0/1074045356 shutdown_connections 2024-09-17T04:35:20.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.596+0000 7f7421870640 1 -- 172.21.15.43:0/1074045356 wait complete. 2024-09-17T04:35:20.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.598+0000 7f7421870640 1 Processor -- start 2024-09-17T04:35:20.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.598+0000 7f7421870640 1 -- start start 2024-09-17T04:35:20.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.599+0000 7f7421870640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74080039b0 0x7f741c1f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.599+0000 7f7421870640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c0c7590 0x7f741c1f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.599+0000 7f7421870640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f741c1f1be0 0x7f741c154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.599+0000 7f7421870640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f741c15c2a0 con 0x7f741c1f1be0 2024-09-17T04:35:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.599+0000 7f7421870640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f741c15bfc0 con 0x7f741c0c7590 2024-09-17T04:35:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.599+0000 7f7421870640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f741c15fda0 con 0x7f74080039b0 2024-09-17T04:35:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.599+0000 7f741b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f741c1f1be0 0x7f741c154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.599+0000 7f741affd640 1 -- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74080039b0 msgr2=0x7f741c1f06e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:3301/0 2024-09-17T04:35:20.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.599+0000 7f741affd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74080039b0 0x7f741c1f06e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:35:20.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.599+0000 7f741b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f741c1f1be0 0x7f741c154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34360/0 (socket says 172.21.15.43:34360) 2024-09-17T04:35:20.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.599+0000 7f741b7fe640 1 -- 172.21.15.43:0/3782252409 learned_addr learned my addr 172.21.15.43:0/3782252409 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:20.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.599+0000 7f741a7fc640 1 --2- 172.21.15.43:0/3782252409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c0c7590 0x7f741c1f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.600+0000 7f741b7fe640 1 -- 172.21.15.43:0/3782252409 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74080039b0 msgr2=0x7f741c1f06e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:35:20.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.600+0000 7f741b7fe640 1 --2- 172.21.15.43:0/3782252409 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74080039b0 0x7f741c1f06e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.600+0000 7f741b7fe640 1 -- 172.21.15.43:0/3782252409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c0c7590 msgr2=0x7f741c1f16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.600+0000 7f741b7fe640 1 --2- 172.21.15.43:0/3782252409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c0c7590 0x7f741c1f16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.600+0000 7f741b7fe640 1 -- 172.21.15.43:0/3782252409 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741c1f0c20 con 0x7f741c1f1be0 2024-09-17T04:35:20.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.600+0000 7f741b7fe640 1 --2- 172.21.15.43:0/3782252409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f741c1f1be0 0x7f741c154bb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7414005fd0 tx=0x7f741400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:20.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.600+0000 7f7413fff640 1 -- 172.21.15.43:0/3782252409 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414003d80 con 0x7f741c1f1be0 2024-09-17T04:35:20.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.600+0000 7f7413fff640 1 -- 172.21.15.43:0/3782252409 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7414004b20 con 0x7f741c1f1be0 2024-09-17T04:35:20.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.600+0000 7f7421870640 1 -- 172.21.15.43:0/3782252409 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f741c0c7a90 con 0x7f741c1f1be0 2024-09-17T04:35:20.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.600+0000 7f7413fff640 1 -- 172.21.15.43:0/3782252409 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414004030 con 0x7f741c1f1be0 2024-09-17T04:35:20.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.600+0000 7f7421870640 1 -- 172.21.15.43:0/3782252409 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f741c1f21a0 con 0x7f741c1f1be0 2024-09-17T04:35:20.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.601+0000 7f7421870640 1 -- 172.21.15.43:0/3782252409 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f741c0ccbd0 con 0x7f741c1f1be0 2024-09-17T04:35:20.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.602+0000 7f7413fff640 1 -- 172.21.15.43:0/3782252409 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f74140041d0 con 0x7f741c1f1be0 2024-09-17T04:35:20.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.602+0000 7f7413fff640 1 --2- 172.21.15.43:0/3782252409 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f73fc078b40 0x7f73fc07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:20.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.603+0000 7f7413fff640 1 -- 172.21.15.43:0/3782252409 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f741409bc40 con 0x7f741c1f1be0 2024-09-17T04:35:20.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.603+0000 7f741affd640 1 --2- 172.21.15.43:0/3782252409 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f73fc078b40 0x7f73fc07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:20.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.603+0000 7f741affd640 1 --2- 172.21.15.43:0/3782252409 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f73fc078b40 0x7f73fc07b050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f740c033000 tx=0x7f741c15c580 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:20.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.607+0000 7f7413fff640 1 -- 172.21.15.43:0/3782252409 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7414020020 con 0x7f741c1f1be0 2024-09-17T04:35:20.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.865+0000 7f7421870640 1 -- 172.21.15.43:0/3782252409 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f741c159670 con 0x7f741c1f1be0 2024-09-17T04:35:20.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.866+0000 7f7413fff640 1 -- 172.21.15.43:0/3782252409 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f7414063f60 con 0x7f741c1f1be0 2024-09-17T04:35:20.866 INFO:teuthology.orchestra.run.smithi043.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":54,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","modified":"2024-09-17T04:33:51.199044Z","created":"2024-09-17T04:33:51.199044Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3301","nonce":0},{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-17T04:35:20.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.868+0000 7f7421870640 1 -- 172.21.15.43:0/3782252409 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f73fc078b40 msgr2=0x7f73fc07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.868+0000 7f7421870640 1 --2- 172.21.15.43:0/3782252409 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f73fc078b40 0x7f73fc07b050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f740c033000 tx=0x7f741c15c580 comp rx=0 tx=0).stop 2024-09-17T04:35:20.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.868+0000 7f7421870640 1 -- 172.21.15.43:0/3782252409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f741c1f1be0 msgr2=0x7f741c154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:20.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.868+0000 7f7421870640 1 --2- 172.21.15.43:0/3782252409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f741c1f1be0 0x7f741c154bb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7414005fd0 tx=0x7f741400f790 comp rx=0 tx=0).stop 2024-09-17T04:35:20.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.868+0000 7f7421870640 1 -- 172.21.15.43:0/3782252409 shutdown_connections 2024-09-17T04:35:20.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.868+0000 7f7421870640 1 --2- 172.21.15.43:0/3782252409 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f73fc078b40 0x7f73fc07b050 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.868+0000 7f7421870640 1 --2- 172.21.15.43:0/3782252409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c0c7590 0x7f741c1f16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.868+0000 7f7421870640 1 --2- 172.21.15.43:0/3782252409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f741c1f1be0 0x7f741c154bb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.868+0000 7f7421870640 1 --2- 172.21.15.43:0/3782252409 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74080039b0 0x7f741c1f06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:20.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.868+0000 7f7421870640 1 -- 172.21.15.43:0/3782252409 >> 172.21.15.43:0/3782252409 conn(0x7f741c06f4e0 msgr2=0x7f741c0761d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:20.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.868+0000 7f7421870640 1 -- 172.21.15.43:0/3782252409 shutdown_connections 2024-09-17T04:35:20.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:20.868+0000 7f7421870640 1 -- 172.21.15.43:0/3782252409 wait complete. 2024-09-17T04:35:23.880 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-17T04:35:24.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.010+0000 7f8b4464d640 1 -- 172.21.15.43:0/1847461812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c073060 msgr2=0x7f8b3c073470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:24.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.010+0000 7f8b4464d640 1 --2- 172.21.15.43:0/1847461812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c073060 0x7f8b3c073470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c005fd0 tx=0x7f8b2c02ab40 comp rx=0 tx=0).stop 2024-09-17T04:35:24.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.011+0000 7f8b4464d640 1 -- 172.21.15.43:0/1847461812 shutdown_connections 2024-09-17T04:35:24.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.011+0000 7f8b4464d640 1 --2- 172.21.15.43:0/1847461812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c073060 0x7f8b3c073470 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:24.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.011+0000 7f8b4464d640 1 --2- 172.21.15.43:0/1847461812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b3c0c3910 0x7f8b3c0726b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:24.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.011+0000 7f8b4464d640 1 -- 172.21.15.43:0/1847461812 >> 172.21.15.43:0/1847461812 conn(0x7f8b3c070540 msgr2=0x7f8b3c070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:24.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.011+0000 7f8b4464d640 1 -- 172.21.15.43:0/1847461812 shutdown_connections 2024-09-17T04:35:24.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.011+0000 7f8b4464d640 1 -- 172.21.15.43:0/1847461812 wait complete. 2024-09-17T04:35:24.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.012+0000 7f8b4464d640 1 Processor -- start 2024-09-17T04:35:24.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.013+0000 7f8b4464d640 1 -- start start 2024-09-17T04:35:24.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b4464d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b3c073060 0x7f8b3c0ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:24.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b4464d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b3c0c3910 0x7f8b3c1e3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:24.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b4464d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c0c9200 0x7f8b3c153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:24.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b4464d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3c0c9b40 con 0x7f8b3c0c9200 2024-09-17T04:35:24.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b4464d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3c0c99c0 con 0x7f8b3c0c3910 2024-09-17T04:35:24.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b4464d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8b3c0c9cc0 con 0x7f8b3c073060 2024-09-17T04:35:24.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b423e9640 1 -- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b3c073060 msgr2=0x7f8b3c0ab6d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:3301/0 2024-09-17T04:35:24.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b423e9640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b3c073060 0x7f8b3c0ab6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:35:24.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b42bea640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c0c9200 0x7f8b3c153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:24.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b42bea640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c0c9200 0x7f8b3c153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34376/0 (socket says 172.21.15.43:34376) 2024-09-17T04:35:24.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b42bea640 1 -- 172.21.15.43:0/2503209957 learned_addr learned my addr 172.21.15.43:0/2503209957 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:24.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b41be8640 1 --2- 172.21.15.43:0/2503209957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b3c0c3910 0x7f8b3c1e3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:24.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b42bea640 1 -- 172.21.15.43:0/2503209957 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b3c073060 msgr2=0x7f8b3c0ab6d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:35:24.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b42bea640 1 --2- 172.21.15.43:0/2503209957 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b3c073060 0x7f8b3c0ab6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:24.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b42bea640 1 -- 172.21.15.43:0/2503209957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b3c0c3910 msgr2=0x7f8b3c1e3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:24.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b42bea640 1 --2- 172.21.15.43:0/2503209957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b3c0c3910 0x7f8b3c1e3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:24.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b42bea640 1 -- 172.21.15.43:0/2503209957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3c1524d0 con 0x7f8b3c0c9200 2024-09-17T04:35:24.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.014+0000 7f8b42bea640 1 --2- 172.21.15.43:0/2503209957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c0c9200 0x7f8b3c153250 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c009d90 tx=0x7f8b2c02c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:24.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.015+0000 7f8b3affd640 1 -- 172.21.15.43:0/2503209957 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c044070 con 0x7f8b3c0c9200 2024-09-17T04:35:24.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.015+0000 7f8b3affd640 1 -- 172.21.15.43:0/2503209957 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b2c004250 con 0x7f8b3c0c9200 2024-09-17T04:35:24.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.015+0000 7f8b4464d640 1 -- 172.21.15.43:0/2503209957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b3c0cab00 con 0x7f8b3c0c9200 2024-09-17T04:35:24.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.015+0000 7f8b3affd640 1 -- 172.21.15.43:0/2503209957 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c0046a0 con 0x7f8b3c0c9200 2024-09-17T04:35:24.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.015+0000 7f8b4464d640 1 -- 172.21.15.43:0/2503209957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b3c1e4370 con 0x7f8b3c0c9200 2024-09-17T04:35:24.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.016+0000 7f8b4464d640 1 -- 172.21.15.43:0/2503209957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b3c1e41a0 con 0x7f8b3c0c9200 2024-09-17T04:35:24.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.017+0000 7f8b3affd640 1 -- 172.21.15.43:0/2503209957 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b2c036400 con 0x7f8b3c0c9200 2024-09-17T04:35:24.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.017+0000 7f8b3affd640 1 --2- 172.21.15.43:0/2503209957 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8b28078b40 0x7f8b2807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:24.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.017+0000 7f8b3affd640 1 -- 172.21.15.43:0/2503209957 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8b2c0bb440 con 0x7f8b3c0c9200 2024-09-17T04:35:24.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.018+0000 7f8b423e9640 1 --2- 172.21.15.43:0/2503209957 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8b28078b40 0x7f8b2807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:24.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.018+0000 7f8b423e9640 1 --2- 172.21.15.43:0/2503209957 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8b28078b40 0x7f8b2807b050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8b34000bc0 tx=0x7f8b340079f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:24.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.022+0000 7f8b3affd640 1 -- 172.21.15.43:0/2503209957 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8b2c032030 con 0x7f8b3c0c9200 2024-09-17T04:35:24.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.279+0000 7f8b4464d640 1 -- 172.21.15.43:0/2503209957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8b3c1e45d0 con 0x7f8b3c0c9200 2024-09-17T04:35:24.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.280+0000 7f8b3affd640 1 -- 172.21.15.43:0/2503209957 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f8b2c083230 con 0x7f8b3c0c9200 2024-09-17T04:35:24.280 INFO:teuthology.orchestra.run.smithi043.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":57,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","modified":"2024-09-17T04:33:51.199044Z","created":"2024-09-17T04:33:51.199044Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3301","nonce":0},{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-17T04:35:24.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.282+0000 7f8b4464d640 1 -- 172.21.15.43:0/2503209957 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8b28078b40 msgr2=0x7f8b2807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:24.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.282+0000 7f8b4464d640 1 --2- 172.21.15.43:0/2503209957 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8b28078b40 0x7f8b2807b050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8b34000bc0 tx=0x7f8b340079f0 comp rx=0 tx=0).stop 2024-09-17T04:35:24.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.282+0000 7f8b4464d640 1 -- 172.21.15.43:0/2503209957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c0c9200 msgr2=0x7f8b3c153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:24.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.282+0000 7f8b4464d640 1 --2- 172.21.15.43:0/2503209957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c0c9200 0x7f8b3c153250 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c009d90 tx=0x7f8b2c02c8b0 comp rx=0 tx=0).stop 2024-09-17T04:35:24.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.282+0000 7f8b4464d640 1 -- 172.21.15.43:0/2503209957 shutdown_connections 2024-09-17T04:35:24.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.282+0000 7f8b4464d640 1 --2- 172.21.15.43:0/2503209957 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f8b28078b40 0x7f8b2807b050 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:24.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.282+0000 7f8b4464d640 1 --2- 172.21.15.43:0/2503209957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b3c0c3910 0x7f8b3c1e3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:24.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.282+0000 7f8b4464d640 1 --2- 172.21.15.43:0/2503209957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c0c9200 0x7f8b3c153250 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:24.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.282+0000 7f8b4464d640 1 --2- 172.21.15.43:0/2503209957 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b3c073060 0x7f8b3c0ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:24.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.282+0000 7f8b4464d640 1 -- 172.21.15.43:0/2503209957 >> 172.21.15.43:0/2503209957 conn(0x7f8b3c070540 msgr2=0x7f8b3c1e18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:24.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.282+0000 7f8b4464d640 1 -- 172.21.15.43:0/2503209957 shutdown_connections 2024-09-17T04:35:24.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:24.282+0000 7f8b4464d640 1 -- 172.21.15.43:0/2503209957 wait complete. 2024-09-17T04:35:27.294 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-17T04:35:27.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.424+0000 7f58b7bdf640 1 -- 172.21.15.43:0/2491091019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58b0158820 msgr2=0x7f58b006ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:27.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.424+0000 7f58b7bdf640 1 --2- 172.21.15.43:0/2491091019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58b0158820 0x7f58b006ddc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f58a8009830 tx=0x7f58a802a5c0 comp rx=0 tx=0).stop 2024-09-17T04:35:27.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.425+0000 7f58b7bdf640 1 -- 172.21.15.43:0/2491091019 shutdown_connections 2024-09-17T04:35:27.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.425+0000 7f58b7bdf640 1 --2- 172.21.15.43:0/2491091019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58b0158820 0x7f58b006ddc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:27.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.425+0000 7f58b7bdf640 1 --2- 172.21.15.43:0/2491091019 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b014e6d0 0x7f58b01582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:27.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.425+0000 7f58b7bdf640 1 -- 172.21.15.43:0/2491091019 >> 172.21.15.43:0/2491091019 conn(0x7f58b0070540 msgr2=0x7f58b0070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:27.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.425+0000 7f58b7bdf640 1 -- 172.21.15.43:0/2491091019 shutdown_connections 2024-09-17T04:35:27.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.425+0000 7f58b7bdf640 1 -- 172.21.15.43:0/2491091019 wait complete. 2024-09-17T04:35:27.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.426+0000 7f58b7bdf640 1 Processor -- start 2024-09-17T04:35:27.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.427+0000 7f58b7bdf640 1 -- start start 2024-09-17T04:35:27.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.428+0000 7f58b7bdf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58b00c2050 0x7f58b00c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:27.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.428+0000 7f58b7bdf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58b014e6d0 0x7f58b0145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:27.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.428+0000 7f58b7bdf640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b0158820 0x7f58b00ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:27.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.428+0000 7f58b7bdf640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f58b00c2460 con 0x7f58b014e6d0 2024-09-17T04:35:27.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.428+0000 7f58b7bdf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f58b00c9460 con 0x7f58b00c2050 2024-09-17T04:35:27.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.428+0000 7f58b7bdf640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f58b0157dc0 con 0x7f58b0158820 2024-09-17T04:35:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.428+0000 7f58b617c640 1 -- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b0158820 msgr2=0x7f58b00ccfe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:3301/0 2024-09-17T04:35:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.428+0000 7f58b617c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b0158820 0x7f58b00ccfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:35:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.428+0000 7f58b517a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58b014e6d0 0x7f58b0145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.428+0000 7f58b517a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58b014e6d0 0x7f58b0145e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34388/0 (socket says 172.21.15.43:34388) 2024-09-17T04:35:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.428+0000 7f58b517a640 1 -- 172.21.15.43:0/4260191082 learned_addr learned my addr 172.21.15.43:0/4260191082 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.428+0000 7f58b597b640 1 --2- 172.21.15.43:0/4260191082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58b00c2050 0x7f58b00c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.428+0000 7f58b517a640 1 -- 172.21.15.43:0/4260191082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b0158820 msgr2=0x7f58b00ccfe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:35:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.428+0000 7f58b517a640 1 --2- 172.21.15.43:0/4260191082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b0158820 0x7f58b00ccfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.428+0000 7f58b517a640 1 -- 172.21.15.43:0/4260191082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58b00c2050 msgr2=0x7f58b00c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.428+0000 7f58b517a640 1 --2- 172.21.15.43:0/4260191082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58b00c2050 0x7f58b00c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.428+0000 7f58b517a640 1 -- 172.21.15.43:0/4260191082 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b00cd520 con 0x7f58b014e6d0 2024-09-17T04:35:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.429+0000 7f58b517a640 1 --2- 172.21.15.43:0/4260191082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58b014e6d0 0x7f58b0145e10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f58a400b580 tx=0x7f58a400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:27.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.429+0000 7f58ae7fc640 1 -- 172.21.15.43:0/4260191082 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4014070 con 0x7f58b014e6d0 2024-09-17T04:35:27.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.429+0000 7f58ae7fc640 1 -- 172.21.15.43:0/4260191082 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58a40109a0 con 0x7f58b014e6d0 2024-09-17T04:35:27.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.429+0000 7f58b7bdf640 1 -- 172.21.15.43:0/4260191082 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b0152190 con 0x7f58b014e6d0 2024-09-17T04:35:27.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.429+0000 7f58ae7fc640 1 -- 172.21.15.43:0/4260191082 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4010df0 con 0x7f58b014e6d0 2024-09-17T04:35:27.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.429+0000 7f58b7bdf640 1 -- 172.21.15.43:0/4260191082 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b01f0570 con 0x7f58b014e6d0 2024-09-17T04:35:27.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.430+0000 7f58b7bdf640 1 -- 172.21.15.43:0/4260191082 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b0072ec0 con 0x7f58b014e6d0 2024-09-17T04:35:27.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.431+0000 7f58ae7fc640 1 -- 172.21.15.43:0/4260191082 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f58a4017070 con 0x7f58b014e6d0 2024-09-17T04:35:27.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.431+0000 7f58ae7fc640 1 --2- 172.21.15.43:0/4260191082 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f589c078b70 0x7f589c07b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:27.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.432+0000 7f58ae7fc640 1 -- 172.21.15.43:0/4260191082 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f58a409aff0 con 0x7f58b014e6d0 2024-09-17T04:35:27.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.432+0000 7f58b597b640 1 --2- 172.21.15.43:0/4260191082 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f589c078b70 0x7f589c07b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:27.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.432+0000 7f58b597b640 1 --2- 172.21.15.43:0/4260191082 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f589c078b70 0x7f589c07b080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f58a0002200 tx=0x7f58a00019f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:27.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.435+0000 7f58ae7fc640 1 -- 172.21.15.43:0/4260191082 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f58a4062e70 con 0x7f58b014e6d0 2024-09-17T04:35:27.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.691+0000 7f58b7bdf640 1 -- 172.21.15.43:0/4260191082 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f58b0072900 con 0x7f58b014e6d0 2024-09-17T04:35:27.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.691+0000 7f58ae7fc640 1 -- 172.21.15.43:0/4260191082 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f58a40678a0 con 0x7f58b014e6d0 2024-09-17T04:35:27.691 INFO:teuthology.orchestra.run.smithi043.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":61,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","modified":"2024-09-17T04:33:51.199044Z","created":"2024-09-17T04:33:51.199044Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3301","nonce":0},{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-17T04:35:27.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.693+0000 7f58b7bdf640 1 -- 172.21.15.43:0/4260191082 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f589c078b70 msgr2=0x7f589c07b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:27.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.693+0000 7f58b7bdf640 1 --2- 172.21.15.43:0/4260191082 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f589c078b70 0x7f589c07b080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f58a0002200 tx=0x7f58a00019f0 comp rx=0 tx=0).stop 2024-09-17T04:35:27.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.693+0000 7f58b7bdf640 1 -- 172.21.15.43:0/4260191082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58b014e6d0 msgr2=0x7f58b0145e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:27.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.693+0000 7f58b7bdf640 1 --2- 172.21.15.43:0/4260191082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58b014e6d0 0x7f58b0145e10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f58a400b580 tx=0x7f58a400ba40 comp rx=0 tx=0).stop 2024-09-17T04:35:27.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.694+0000 7f58b7bdf640 1 -- 172.21.15.43:0/4260191082 shutdown_connections 2024-09-17T04:35:27.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.694+0000 7f58b7bdf640 1 --2- 172.21.15.43:0/4260191082 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f589c078b70 0x7f589c07b080 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:27.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.694+0000 7f58b7bdf640 1 --2- 172.21.15.43:0/4260191082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b0158820 0x7f58b00ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:27.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.694+0000 7f58b7bdf640 1 --2- 172.21.15.43:0/4260191082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58b014e6d0 0x7f58b0145e10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:27.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.694+0000 7f58b7bdf640 1 --2- 172.21.15.43:0/4260191082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58b00c2050 0x7f58b00c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:27.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.694+0000 7f58b7bdf640 1 -- 172.21.15.43:0/4260191082 >> 172.21.15.43:0/4260191082 conn(0x7f58b0070540 msgr2=0x7f58b014ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:27.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.694+0000 7f58b7bdf640 1 -- 172.21.15.43:0/4260191082 shutdown_connections 2024-09-17T04:35:27.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:27.694+0000 7f58b7bdf640 1 -- 172.21.15.43:0/4260191082 wait complete. 2024-09-17T04:35:30.705 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-17T04:35:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.847+0000 7fcad6551640 1 -- 172.21.15.43:0/410519001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcab80039b0 msgr2=0x7fcab8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.847+0000 7fcad6551640 1 --2- 172.21.15.43:0/410519001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcab80039b0 0x7fcab8003e00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcac0001160 tx=0x7fcab8005830 comp rx=0 tx=0).stop 2024-09-17T04:35:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.847+0000 7fcad6551640 1 -- 172.21.15.43:0/410519001 shutdown_connections 2024-09-17T04:35:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.847+0000 7fcad6551640 1 --2- 172.21.15.43:0/410519001 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab8005350 0x7fcab800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.847+0000 7fcad6551640 1 --2- 172.21.15.43:0/410519001 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab8004800 0x7fcab8004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.847+0000 7fcad6551640 1 --2- 172.21.15.43:0/410519001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcab80039b0 0x7fcab8003e00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.847+0000 7fcad6551640 1 -- 172.21.15.43:0/410519001 >> 172.21.15.43:0/410519001 conn(0x7fcad00cbb10 msgr2=0x7fcad00cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.848+0000 7fcad6551640 1 -- 172.21.15.43:0/410519001 shutdown_connections 2024-09-17T04:35:39.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.848+0000 7fcad6551640 1 -- 172.21.15.43:0/410519001 wait complete. 2024-09-17T04:35:39.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.850+0000 7fcad6551640 1 Processor -- start 2024-09-17T04:35:39.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.850+0000 7fcad6551640 1 -- start start 2024-09-17T04:35:39.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.851+0000 7fcad6551640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab80039b0 0x7fcad00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:39.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.851+0000 7fcad6551640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcab8004800 0x7fcad0158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:39.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.851+0000 7fcad6551640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab8005350 0x7fcad01577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:39.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.851+0000 7fcad6551640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcad015a760 con 0x7fcab8004800 2024-09-17T04:35:39.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.851+0000 7fcad6551640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fcad0071060 con 0x7fcab80039b0 2024-09-17T04:35:39.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.851+0000 7fcad6551640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fcad015adf0 con 0x7fcab8005350 2024-09-17T04:35:39.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.851+0000 7fcad4aee640 1 -- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab8005350 msgr2=0x7fcad01577a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:3301/0 2024-09-17T04:35:39.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.851+0000 7fcad4aee640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab8005350 0x7fcad01577a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:35:39.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.851+0000 7fcacf7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcab8004800 0x7fcad0158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:39.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.851+0000 7fcacf7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcab8004800 0x7fcad0158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45942/0 (socket says 172.21.15.43:45942) 2024-09-17T04:35:39.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.851+0000 7fcacf7fe640 1 -- 172.21.15.43:0/2614218333 learned_addr learned my addr 172.21.15.43:0/2614218333 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:39.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.851+0000 7fcacffff640 1 --2- 172.21.15.43:0/2614218333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab80039b0 0x7fcad00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:39.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.852+0000 7fcacf7fe640 1 -- 172.21.15.43:0/2614218333 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab8005350 msgr2=0x7fcad01577a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:35:39.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.852+0000 7fcacf7fe640 1 --2- 172.21.15.43:0/2614218333 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab8005350 0x7fcad01577a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:39.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.852+0000 7fcacf7fe640 1 -- 172.21.15.43:0/2614218333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab80039b0 msgr2=0x7fcad00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.852+0000 7fcacf7fe640 1 --2- 172.21.15.43:0/2614218333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab80039b0 0x7fcad00cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.852+0000 7fcacf7fe640 1 -- 172.21.15.43:0/2614218333 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad01f0420 con 0x7fcab8004800 2024-09-17T04:35:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.852+0000 7fcacf7fe640 1 --2- 172.21.15.43:0/2614218333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcab8004800 0x7fcad0158aa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcac4013a80 tx=0x7fcac4013f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.852+0000 7fcaccff9640 1 -- 172.21.15.43:0/2614218333 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac400fe10 con 0x7fcab8004800 2024-09-17T04:35:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.852+0000 7fcaccff9640 1 -- 172.21.15.43:0/2614218333 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcac4004140 con 0x7fcab8004800 2024-09-17T04:35:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.852+0000 7fcad6551640 1 -- 172.21.15.43:0/2614218333 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad00cd860 con 0x7fcab8004800 2024-09-17T04:35:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.852+0000 7fcaccff9640 1 -- 172.21.15.43:0/2614218333 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac40035f0 con 0x7fcab8004800 2024-09-17T04:35:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.852+0000 7fcad6551640 1 -- 172.21.15.43:0/2614218333 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad00ce680 con 0x7fcab8004800 2024-09-17T04:35:39.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.853+0000 7fcad6551640 1 -- 172.21.15.43:0/2614218333 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad00c8eb0 con 0x7fcab8004800 2024-09-17T04:35:39.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.854+0000 7fcaccff9640 1 -- 172.21.15.43:0/2614218333 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcac4003790 con 0x7fcab8004800 2024-09-17T04:35:39.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.854+0000 7fcaccff9640 1 --2- 172.21.15.43:0/2614218333 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fcabc07a670 0x7fcabc07cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:39.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.854+0000 7fcaccff9640 1 -- 172.21.15.43:0/2614218333 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5833+0+0 (secure 0 0 0) 0x7fcac409bfe0 con 0x7fcab8004800 2024-09-17T04:35:39.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.855+0000 7fcacffff640 1 --2- 172.21.15.43:0/2614218333 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fcabc07a670 0x7fcabc07cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:39.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.855+0000 7fcacffff640 1 --2- 172.21.15.43:0/2614218333 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fcabc07a670 0x7fcabc07cb80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcac0037000 tx=0x7fcac002e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:39.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:39.863+0000 7fcaccff9640 1 -- 172.21.15.43:0/2614218333 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcac4018070 con 0x7fcab8004800 2024-09-17T04:35:40.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.130+0000 7fcad6551640 1 -- 172.21.15.43:0/2614218333 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcad0152cd0 con 0x7fcab8004800 2024-09-17T04:35:40.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.130+0000 7fcaccff9640 1 -- 172.21.15.43:0/2614218333 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1549 (secure 0 0 0) 0x7fcac4063cd0 con 0x7fcab8004800 2024-09-17T04:35:40.131 INFO:teuthology.orchestra.run.smithi043.stdout:{"election_epoch":8,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","modified":"2024-09-17T04:33:51.199044Z","created":"2024-09-17T04:33:51.199044Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3301","nonce":0},{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-17T04:35:40.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.133+0000 7fcad6551640 1 -- 172.21.15.43:0/2614218333 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fcabc07a670 msgr2=0x7fcabc07cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:40.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.133+0000 7fcad6551640 1 --2- 172.21.15.43:0/2614218333 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fcabc07a670 0x7fcabc07cb80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcac0037000 tx=0x7fcac002e040 comp rx=0 tx=0).stop 2024-09-17T04:35:40.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.133+0000 7fcad6551640 1 -- 172.21.15.43:0/2614218333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcab8004800 msgr2=0x7fcad0158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:40.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.133+0000 7fcad6551640 1 --2- 172.21.15.43:0/2614218333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcab8004800 0x7fcad0158aa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcac4013a80 tx=0x7fcac4013f40 comp rx=0 tx=0).stop 2024-09-17T04:35:40.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.133+0000 7fcad6551640 1 -- 172.21.15.43:0/2614218333 shutdown_connections 2024-09-17T04:35:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.133+0000 7fcad6551640 1 --2- 172.21.15.43:0/2614218333 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fcabc07a670 0x7fcabc07cb80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.133+0000 7fcad6551640 1 --2- 172.21.15.43:0/2614218333 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab8005350 0x7fcad01577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.133+0000 7fcad6551640 1 --2- 172.21.15.43:0/2614218333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcab8004800 0x7fcad0158aa0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.133+0000 7fcad6551640 1 --2- 172.21.15.43:0/2614218333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab80039b0 0x7fcad00cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.133+0000 7fcad6551640 1 -- 172.21.15.43:0/2614218333 >> 172.21.15.43:0/2614218333 conn(0x7fcad00cbb10 msgr2=0x7fcad0151050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.133+0000 7fcad6551640 1 -- 172.21.15.43:0/2614218333 shutdown_connections 2024-09-17T04:35:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.133+0000 7fcad6551640 1 -- 172.21.15.43:0/2614218333 wait complete. 2024-09-17T04:35:40.145 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-17T04:35:40.145 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-17T04:35:40.145 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-17T04:35:40.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.266+0000 7fbc45238640 1 -- 172.21.15.43:0/2968039662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc28004800 msgr2=0x7fbc28004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:40.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.266+0000 7fbc45238640 1 --2- 172.21.15.43:0/2968039662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc28004800 0x7fbc28004c10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbc34001740 tx=0x7fbc28005830 comp rx=0 tx=0).stop 2024-09-17T04:35:40.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.266+0000 7fbc45238640 1 -- 172.21.15.43:0/2968039662 shutdown_connections 2024-09-17T04:35:40.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.266+0000 7fbc45238640 1 --2- 172.21.15.43:0/2968039662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc28004800 0x7fbc28004c10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:40.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.266+0000 7fbc45238640 1 -- 172.21.15.43:0/2968039662 >> 172.21.15.43:0/2968039662 conn(0x7fbc40070540 msgr2=0x7fbc40070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:40.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.266+0000 7fbc45238640 1 -- 172.21.15.43:0/2968039662 shutdown_connections 2024-09-17T04:35:40.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.266+0000 7fbc45238640 1 -- 172.21.15.43:0/2968039662 wait complete. 2024-09-17T04:35:40.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.268+0000 7fbc45238640 1 Processor -- start 2024-09-17T04:35:40.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.268+0000 7fbc45238640 1 -- start start 2024-09-17T04:35:40.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.269+0000 7fbc45238640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc28004800 0x7fbc401470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:40.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.269+0000 7fbc45238640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc4014fe00 0x7fbc401409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:40.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.269+0000 7fbc45238640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc400caf80 0x7fbc4014a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:40.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.269+0000 7fbc45238640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbc400c8cd0 con 0x7fbc28004800 2024-09-17T04:35:40.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.269+0000 7fbc45238640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbc400c2440 con 0x7fbc400caf80 2024-09-17T04:35:40.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.269+0000 7fbc45238640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fbc400c6f20 con 0x7fbc4014fe00 2024-09-17T04:35:40.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.269+0000 7fbc3e59c640 1 -- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc4014fe00 msgr2=0x7fbc401409f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:3301/0 2024-09-17T04:35:40.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.269+0000 7fbc3ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc28004800 0x7fbc401470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:40.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.269+0000 7fbc3e59c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc4014fe00 0x7fbc401409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:35:40.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.269+0000 7fbc3ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc28004800 0x7fbc401470a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48806/0 (socket says 172.21.15.43:48806) 2024-09-17T04:35:40.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.269+0000 7fbc3ed9d640 1 -- 172.21.15.43:0/2551111823 learned_addr learned my addr 172.21.15.43:0/2551111823 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:40.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.270+0000 7fbc3f59e640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc400caf80 0x7fbc4014a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:40.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.270+0000 7fbc3ed9d640 1 -- 172.21.15.43:0/2551111823 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc4014fe00 msgr2=0x7fbc401409f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:35:40.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.270+0000 7fbc3ed9d640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc4014fe00 0x7fbc401409f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:40.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.270+0000 7fbc3ed9d640 1 -- 172.21.15.43:0/2551111823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc400caf80 msgr2=0x7fbc4014a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:40.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.270+0000 7fbc3ed9d640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc400caf80 0x7fbc4014a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:40.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.270+0000 7fbc3ed9d640 1 -- 172.21.15.43:0/2551111823 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc40144ad0 con 0x7fbc28004800 2024-09-17T04:35:40.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.270+0000 7fbc3ed9d640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc28004800 0x7fbc401470a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbc30006660 tx=0x7fbc300039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:40.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.270+0000 7fbc277fe640 1 -- 172.21.15.43:0/2551111823 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc30015070 con 0x7fbc28004800 2024-09-17T04:35:40.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.270+0000 7fbc277fe640 1 -- 172.21.15.43:0/2551111823 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc30011880 con 0x7fbc28004800 2024-09-17T04:35:40.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.270+0000 7fbc45238640 1 -- 172.21.15.43:0/2551111823 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc40140f30 con 0x7fbc28004800 2024-09-17T04:35:40.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.270+0000 7fbc277fe640 1 -- 172.21.15.43:0/2551111823 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc30011cd0 con 0x7fbc28004800 2024-09-17T04:35:40.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.270+0000 7fbc45238640 1 -- 172.21.15.43:0/2551111823 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc401505a0 con 0x7fbc28004800 2024-09-17T04:35:40.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.271+0000 7fbc45238640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc4014ab20 0x7fbc40146800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:40.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.271+0000 7fbc45238640 1 -- 172.21.15.43:0/2551111823 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4014e960 con 0x7fbc4014ab20 2024-09-17T04:35:40.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.272+0000 7fbc3e59c640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc4014ab20 0x7fbc40146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:40.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.272+0000 7fbc3e59c640 1 -- 172.21.15.43:0/2551111823 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc40153e10 con 0x7fbc4014ab20 2024-09-17T04:35:40.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.272+0000 7fbc277fe640 1 -- 172.21.15.43:0/2551111823 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbc30018070 con 0x7fbc28004800 2024-09-17T04:35:40.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.272+0000 7fbc3e59c640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc4014ab20 0x7fbc40146800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbc3402f000 tx=0x7fbc3402af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:40.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.273+0000 7fbc277fe640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fbc2c078b40 0x7fbc2c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:40.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.273+0000 7fbc277fe640 1 -- 172.21.15.43:0/2551111823 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5833+0+0 (secure 0 0 0) 0x7fbc3009ba90 con 0x7fbc28004800 2024-09-17T04:35:40.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.273+0000 7fbc277fe640 1 -- 172.21.15.43:0/2551111823 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34038070 con 0x7fbc4014ab20 2024-09-17T04:35:40.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.273+0000 7fbc277fe640 1 -- 172.21.15.43:0/2551111823 <== mon.0 v2:172.21.15.43:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbc3402e040 con 0x7fbc4014ab20 2024-09-17T04:35:40.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.273+0000 7fbc277fe640 1 -- 172.21.15.43:0/2551111823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc4014ab20 msgr2=0x7fbc40146800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:40.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.273+0000 7fbc277fe640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc4014ab20 0x7fbc40146800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbc3402f000 tx=0x7fbc3402af30 comp rx=0 tx=0).stop 2024-09-17T04:35:40.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.273+0000 7fbc277fe640 1 -- 172.21.15.43:0/2551111823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc4014ab20 msgr2=0x7fbc40146800 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:35:40.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.273+0000 7fbc277fe640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc4014ab20 0x7fbc40146800 secure :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbc3402f000 tx=0x7fbc3402af30 comp rx=0 tx=0).stop 2024-09-17T04:35:40.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.273+0000 7fbc3f59e640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fbc2c078b40 0x7fbc2c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:40.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.274+0000 7fbc3f59e640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fbc2c078b40 0x7fbc2c07b050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbc400caa10 tx=0x7fbc38009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:40.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.281+0000 7fbc45238640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc401f2b70 0x7fbc401f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:40.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.281+0000 7fbc45238640 1 -- 172.21.15.43:0/2551111823 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbc40146d40 con 0x7fbc401f2b70 2024-09-17T04:35:40.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.281+0000 7fbc3e59c640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc401f2b70 0x7fbc401f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:40.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.281+0000 7fbc3e59c640 1 -- 172.21.15.43:0/2551111823 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbc40159b10 con 0x7fbc401f2b70 2024-09-17T04:35:40.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.281+0000 7fbc3e59c640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc401f2b70 0x7fbc401f2f80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbc34000c00 tx=0x7fbc28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:40.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.281+0000 7fbc277fe640 1 -- 172.21.15.43:0/2551111823 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34044bc0 con 0x7fbc401f2b70 2024-09-17T04:35:40.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.282+0000 7fbc277fe640 1 -- 172.21.15.43:0/2551111823 <== mon.0 v2:172.21.15.43:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5031 (secure 0 0 0) 0x7fbc34044bc0 con 0x7fbc401f2b70 2024-09-17T04:35:40.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.282+0000 7fbc277fe640 1 -- 172.21.15.43:0/2551111823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc401f2b70 msgr2=0x7fbc401f2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:40.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.282+0000 7fbc277fe640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc401f2b70 0x7fbc401f2f80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbc34000c00 tx=0x7fbc28005830 comp rx=0 tx=0).stop 2024-09-17T04:35:40.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.282+0000 7fbc277fe640 1 -- 172.21.15.43:0/2551111823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc401f2b70 msgr2=0x7fbc401f2f80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:35:40.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.282+0000 7fbc277fe640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc401f2b70 0x7fbc401f2f80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:40.283 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-17T04:35:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "a", 2024-09-17T04:35:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 0, 2024-09-17T04:35:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "leader", 2024-09-17T04:35:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: "election_epoch": 8, 2024-09-17T04:35:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 74022, 2024-09-17T04:35:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum": [ 2024-09-17T04:35:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: 0, 2024-09-17T04:35:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: 1 2024-09-17T04:35:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_age": 5, 2024-09-17T04:35:40.283 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:35:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "required_con": "2450521708007866372", 2024-09-17T04:35:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "required_mon": [ 2024-09-17T04:35:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:35:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:35:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:35:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:35:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:35:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:35:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:35:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:35:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:35:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:35:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:35:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_con": "4540719139924082687", 2024-09-17T04:35:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_mon": [ 2024-09-17T04:35:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:35:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:35:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:35:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:35:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:35:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:35:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:35:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:35:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:35:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:35:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:35:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:40.285 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "outside_quorum": [], 2024-09-17T04:35:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "extra_probe_peers": [], 2024-09-17T04:35:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "sync_provider": [], 2024-09-17T04:35:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "monmap": { 2024-09-17T04:35:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 1, 2024-09-17T04:35:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "cdef1e3e-07e6-43e6-b635-3ed1bc15d64a", 2024-09-17T04:35:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:35:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:35:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release": 19, 2024-09-17T04:35:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release_name": "squid", 2024-09-17T04:35:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "election_strategy": 1, 2024-09-17T04:35:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "disallowed_leaders: ": "", 2024-09-17T04:35:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false, 2024-09-17T04:35:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "tiebreaker_mon": "", 2024-09-17T04:35:40.286 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_ranks: ": "", 2024-09-17T04:35:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:35:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "persistent": [ 2024-09-17T04:35:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:35:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:35:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:35:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:35:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:35:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:35:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:35:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:35:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:35:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:35:40.287 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:35:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: "optional": [] 2024-09-17T04:35:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: "mons": [ 2024-09-17T04:35:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 0, 2024-09-17T04:35:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "a", 2024-09-17T04:35:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:35:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:35:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:35:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:3300", 2024-09-17T04:35:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:40.288 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:35:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789", 2024-09-17T04:35:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789/0", 2024-09-17T04:35:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.43:6789/0", 2024-09-17T04:35:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:35:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:35:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:35:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 1, 2024-09-17T04:35:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "b", 2024-09-17T04:35:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:35:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:35:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:35:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3300", 2024-09-17T04:35:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:35:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789", 2024-09-17T04:35:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:40.290 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789/0", 2024-09-17T04:35:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6789/0", 2024-09-17T04:35:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:35:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:35:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:35:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 2, 2024-09-17T04:35:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "c", 2024-09-17T04:35:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:35:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:35:40.291 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:35:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3301", 2024-09-17T04:35:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:35:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790", 2024-09-17T04:35:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790/0", 2024-09-17T04:35:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6790/0", 2024-09-17T04:35:40.292 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:35:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:35:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:35:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: "feature_map": { 2024-09-17T04:35:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": [ 2024-09-17T04:35:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:35:40.293 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": [ 2024-09-17T04:35:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 5 2024-09-17T04:35:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": [ 2024-09-17T04:35:40.294 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 6 2024-09-17T04:35:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "client": [ 2024-09-17T04:35:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 2 2024-09-17T04:35:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": [ 2024-09-17T04:35:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:40.295 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:40.296 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:35:40.296 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.296 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:40.296 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.296 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false 2024-09-17T04:35:40.296 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-17T04:35:40.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.282+0000 7fbc45238640 1 -- 172.21.15.43:0/2551111823 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fbc2c078b40 msgr2=0x7fbc2c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:40.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.282+0000 7fbc45238640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fbc2c078b40 0x7fbc2c07b050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbc400caa10 tx=0x7fbc38009500 comp rx=0 tx=0).stop 2024-09-17T04:35:40.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.282+0000 7fbc45238640 1 -- 172.21.15.43:0/2551111823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc28004800 msgr2=0x7fbc401470a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:40.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.282+0000 7fbc45238640 1 --2- 172.21.15.43:0/2551111823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc28004800 0x7fbc401470a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbc30006660 tx=0x7fbc300039c0 comp rx=0 tx=0).stop 2024-09-17T04:35:40.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.282+0000 7fbc3f59e640 1 -- 172.21.15.43:0/2551111823 reap_dead start 2024-09-17T04:35:40.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.282+0000 7fbc3f59e640 1 -- 172.21.15.43:0/2551111823 reap_dead start 2024-09-17T04:35:40.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.282+0000 7fbc45238640 1 -- 172.21.15.43:0/2551111823 shutdown_connections 2024-09-17T04:35:40.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.282+0000 7fbc45238640 1 -- 172.21.15.43:0/2551111823 >> 172.21.15.43:0/2551111823 conn(0x7fbc40070540 msgr2=0x7fbc4014c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:40.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.282+0000 7fbc45238640 1 -- 172.21.15.43:0/2551111823 shutdown_connections 2024-09-17T04:35:40.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.282+0000 7fbc45238640 1 -- 172.21.15.43:0/2551111823 wait complete. 2024-09-17T04:35:40.299 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-17T04:35:40.300 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-17T04:35:40.300 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-17T04:35:40.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.419+0000 7f9a7b0a2640 1 -- 172.21.15.43:0/3157536999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a740c40a0 msgr2=0x7f9a740c44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:40.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.419+0000 7f9a7b0a2640 1 --2- 172.21.15.43:0/3157536999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a740c40a0 0x7f9a740c44b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c005fd0 tx=0x7f9a6c02a960 comp rx=0 tx=0).stop 2024-09-17T04:35:40.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.419+0000 7f9a7b0a2640 1 -- 172.21.15.43:0/3157536999 shutdown_connections 2024-09-17T04:35:40.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.419+0000 7f9a7b0a2640 1 --2- 172.21.15.43:0/3157536999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a740c40a0 0x7f9a740c44b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:40.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.419+0000 7f9a7b0a2640 1 -- 172.21.15.43:0/3157536999 >> 172.21.15.43:0/3157536999 conn(0x7f9a74068d00 msgr2=0x7f9a74069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:40.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.419+0000 7f9a7b0a2640 1 -- 172.21.15.43:0/3157536999 shutdown_connections 2024-09-17T04:35:40.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.419+0000 7f9a7b0a2640 1 -- 172.21.15.43:0/3157536999 wait complete. 2024-09-17T04:35:40.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.421+0000 7f9a7b0a2640 1 Processor -- start 2024-09-17T04:35:40.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.421+0000 7f9a7b0a2640 1 -- start start 2024-09-17T04:35:40.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.423+0000 7f9a7b0a2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a74070e70 0x7f9a74151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:40.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.423+0000 7f9a7b0a2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a74071aa0 0x7f9a74147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:40.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.423+0000 7f9a7b0a2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a740c40a0 0x7f9a741477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:40.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.423+0000 7f9a7b0a2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9a740c5da0 con 0x7f9a74070e70 2024-09-17T04:35:40.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.423+0000 7f9a7b0a2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9a74070450 con 0x7f9a740c40a0 2024-09-17T04:35:40.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.423+0000 7f9a7b0a2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9a74071eb0 con 0x7f9a74071aa0 2024-09-17T04:35:40.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.423+0000 7f9a78e3e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a74070e70 0x7f9a74151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:40.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.423+0000 7f9a73fff640 1 -- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a74071aa0 msgr2=0x7f9a74147260 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:3301/0 2024-09-17T04:35:40.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.423+0000 7f9a78e3e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a74070e70 0x7f9a74151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48832/0 (socket says 172.21.15.43:48832) 2024-09-17T04:35:40.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.423+0000 7f9a78e3e640 1 -- 172.21.15.43:0/3065083516 learned_addr learned my addr 172.21.15.43:0/3065083516 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:35:40.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.423+0000 7f9a73fff640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a74071aa0 0x7f9a74147260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:35:40.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.423+0000 7f9a7963f640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a740c40a0 0x7f9a741477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:40.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.424+0000 7f9a78e3e640 1 -- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a74071aa0 msgr2=0x7f9a74147260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:35:40.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.424+0000 7f9a78e3e640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a74071aa0 0x7f9a74147260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:40.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.424+0000 7f9a78e3e640 1 -- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a740c40a0 msgr2=0x7f9a741477a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:40.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.424+0000 7f9a78e3e640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a740c40a0 0x7f9a741477a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:40.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.424+0000 7f9a78e3e640 1 -- 172.21.15.43:0/3065083516 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a74151690 con 0x7f9a74070e70 2024-09-17T04:35:40.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.424+0000 7f9a78e3e640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a74070e70 0x7f9a74151150 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800c460 tx=0x7f9a6800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:40.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.424+0000 7f9a717fa640 1 -- 172.21.15.43:0/3065083516 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a680052d0 con 0x7f9a74070e70 2024-09-17T04:35:40.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.424+0000 7f9a717fa640 1 -- 172.21.15.43:0/3065083516 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a68005490 con 0x7f9a74070e70 2024-09-17T04:35:40.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.424+0000 7f9a717fa640 1 -- 172.21.15.43:0/3065083516 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a68012870 con 0x7f9a74070e70 2024-09-17T04:35:40.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.424+0000 7f9a7b0a2640 1 -- 172.21.15.43:0/3065083516 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a74148310 con 0x7f9a74070e70 2024-09-17T04:35:40.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.424+0000 7f9a7b0a2640 1 -- 172.21.15.43:0/3065083516 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a741f34c0 con 0x7f9a74070e70 2024-09-17T04:35:40.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.425+0000 7f9a7b0a2640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a741f37a0 0x7f9a741f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:40.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.425+0000 7f9a7b0a2640 1 -- 172.21.15.43:0/3065083516 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9a74151b60 con 0x7f9a741f37a0 2024-09-17T04:35:40.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.425+0000 7f9a73fff640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a741f37a0 0x7f9a741f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:40.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.426+0000 7f9a73fff640 1 -- 172.21.15.43:0/3065083516 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a741546d0 con 0x7f9a741f37a0 2024-09-17T04:35:40.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.426+0000 7f9a717fa640 1 -- 172.21.15.43:0/3065083516 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a68012a10 con 0x7f9a74070e70 2024-09-17T04:35:40.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.426+0000 7f9a73fff640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a741f37a0 0x7f9a741f3bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9a60001590 tx=0x7f9a6000cb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:40.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.427+0000 7f9a717fa640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9a58078b40 0x7f9a5807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:40.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.427+0000 7f9a717fa640 1 -- 172.21.15.43:0/3065083516 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5833+0+0 (secure 0 0 0) 0x7f9a6809a850 con 0x7f9a74070e70 2024-09-17T04:35:40.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.427+0000 7f9a7963f640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9a58078b40 0x7f9a5807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:40.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.427+0000 7f9a717fa640 1 -- 172.21.15.43:0/3065083516 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a60017070 con 0x7f9a741f37a0 2024-09-17T04:35:40.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.427+0000 7f9a717fa640 1 -- 172.21.15.43:0/3065083516 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9a60005a80 con 0x7f9a741f37a0 2024-09-17T04:35:40.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.427+0000 7f9a717fa640 1 -- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a741f37a0 msgr2=0x7f9a741f3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:40.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.427+0000 7f9a717fa640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a741f37a0 0x7f9a741f3bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9a60001590 tx=0x7f9a6000cb10 comp rx=0 tx=0).stop 2024-09-17T04:35:40.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.427+0000 7f9a717fa640 1 -- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a741f37a0 msgr2=0x7f9a741f3bb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:35:40.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.427+0000 7f9a717fa640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a741f37a0 0x7f9a741f3bb0 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9a60001590 tx=0x7f9a6000cb10 comp rx=0 tx=0).stop 2024-09-17T04:35:40.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.427+0000 7f9a7963f640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9a58078b40 0x7f9a5807b050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c034000 tx=0x7f9a6c004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:40.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.434+0000 7f9a7b0a2640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a740c6530 0x7f9a740c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:35:40.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.434+0000 7f9a7b0a2640 1 -- 172.21.15.43:0/3065083516 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9a740cb730 con 0x7f9a740c6530 2024-09-17T04:35:40.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.434+0000 7f9a73fff640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a740c6530 0x7f9a740c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:35:40.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.435+0000 7f9a73fff640 1 -- 172.21.15.43:0/3065083516 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9a740c9b60 con 0x7f9a740c6530 2024-09-17T04:35:40.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.435+0000 7f9a73fff640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a740c6530 0x7f9a740c6940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a600013f0 tx=0x7f9a60000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:35:40.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.435+0000 7f9a717fa640 1 -- 172.21.15.43:0/3065083516 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a60017040 con 0x7f9a740c6530 2024-09-17T04:35:40.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.435+0000 7f9a717fa640 1 -- 172.21.15.43:0/3065083516 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5172 (secure 0 0 0) 0x7f9a6001a6c0 con 0x7f9a740c6530 2024-09-17T04:35:40.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.435+0000 7f9a717fa640 1 -- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a740c6530 msgr2=0x7f9a740c6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:40.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.435+0000 7f9a717fa640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a740c6530 0x7f9a740c6940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a600013f0 tx=0x7f9a60000bc0 comp rx=0 tx=0).stop 2024-09-17T04:35:40.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.435+0000 7f9a717fa640 1 -- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a740c6530 msgr2=0x7f9a740c6940 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:35:40.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.435+0000 7f9a717fa640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a740c6530 0x7f9a740c6940 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a600013f0 tx=0x7f9a60000bc0 comp rx=0 tx=0).stop 2024-09-17T04:35:40.436 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-17T04:35:40.436 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "b", 2024-09-17T04:35:40.436 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 1, 2024-09-17T04:35:40.436 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "peon", 2024-09-17T04:35:40.436 INFO:teuthology.orchestra.run.smithi043.stdout: "election_epoch": 8, 2024-09-17T04:35:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 74140, 2024-09-17T04:35:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum": [ 2024-09-17T04:35:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: 0, 2024-09-17T04:35:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: 1 2024-09-17T04:35:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_age": 5, 2024-09-17T04:35:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:35:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "required_con": "2450521708007866372", 2024-09-17T04:35:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "required_mon": [ 2024-09-17T04:35:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:35:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:35:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:35:40.437 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:35:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:35:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:35:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:35:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:35:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:35:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:35:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:35:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_con": "4540719139924082687", 2024-09-17T04:35:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_mon": [ 2024-09-17T04:35:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:35:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:35:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:35:40.438 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:35:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:35:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:35:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:35:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:35:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:35:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:35:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:35:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "outside_quorum": [], 2024-09-17T04:35:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "extra_probe_peers": [], 2024-09-17T04:35:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "sync_provider": [], 2024-09-17T04:35:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "monmap": { 2024-09-17T04:35:40.439 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 1, 2024-09-17T04:35:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "cdef1e3e-07e6-43e6-b635-3ed1bc15d64a", 2024-09-17T04:35:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:35:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:35:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release": 19, 2024-09-17T04:35:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release_name": "squid", 2024-09-17T04:35:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "election_strategy": 1, 2024-09-17T04:35:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "disallowed_leaders: ": "", 2024-09-17T04:35:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false, 2024-09-17T04:35:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "tiebreaker_mon": "", 2024-09-17T04:35:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_ranks: ": "", 2024-09-17T04:35:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:35:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "persistent": [ 2024-09-17T04:35:40.440 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:35:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:35:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:35:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:35:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:35:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:35:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:35:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:35:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:35:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:35:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:35:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: "optional": [] 2024-09-17T04:35:40.441 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: "mons": [ 2024-09-17T04:35:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 0, 2024-09-17T04:35:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "a", 2024-09-17T04:35:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:35:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:35:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:35:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:3300", 2024-09-17T04:35:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.442 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:35:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789", 2024-09-17T04:35:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789/0", 2024-09-17T04:35:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.43:6789/0", 2024-09-17T04:35:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:35:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:35:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:35:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.443 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 1, 2024-09-17T04:35:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "b", 2024-09-17T04:35:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:35:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:35:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:35:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3300", 2024-09-17T04:35:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:35:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789", 2024-09-17T04:35:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.444 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789/0", 2024-09-17T04:35:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6789/0", 2024-09-17T04:35:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:35:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:35:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:35:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 2, 2024-09-17T04:35:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "c", 2024-09-17T04:35:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:35:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:35:40.445 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:35:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3301", 2024-09-17T04:35:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:35:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790", 2024-09-17T04:35:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:35:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790/0", 2024-09-17T04:35:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6790/0", 2024-09-17T04:35:40.446 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:35:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:35:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:35:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: "feature_map": { 2024-09-17T04:35:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": [ 2024-09-17T04:35:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:35:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.447 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": [ 2024-09-17T04:35:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:35:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": [ 2024-09-17T04:35:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 2 2024-09-17T04:35:40.448 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: "client": [ 2024-09-17T04:35:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-17T04:35:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "luminous", 2024-09-17T04:35:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:35:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 5 2024-09-17T04:35:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:35:40.449 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": [ 2024-09-17T04:35:40.450 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:35:40.450 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:35:40.450 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:35:40.450 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:35:40.450 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:35:40.450 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:35:40.450 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:35:40.450 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false 2024-09-17T04:35:40.450 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-17T04:35:40.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.436+0000 7f9a7b0a2640 1 -- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9a58078b40 msgr2=0x7f9a5807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:40.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.436+0000 7f9a7b0a2640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9a58078b40 0x7f9a5807b050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c034000 tx=0x7f9a6c004ab0 comp rx=0 tx=0).stop 2024-09-17T04:35:40.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.436+0000 7f9a7b0a2640 1 -- 172.21.15.43:0/3065083516 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a74070e70 msgr2=0x7f9a74151150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:35:40.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.436+0000 7f9a7b0a2640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a74070e70 0x7f9a74151150 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800c460 tx=0x7f9a6800c920 comp rx=0 tx=0).stop 2024-09-17T04:35:40.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.436+0000 7f9a7963f640 1 -- 172.21.15.43:0/3065083516 reap_dead start 2024-09-17T04:35:40.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.436+0000 7f9a7b0a2640 1 -- 172.21.15.43:0/3065083516 shutdown_connections 2024-09-17T04:35:40.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.436+0000 7f9a7b0a2640 1 --2- 172.21.15.43:0/3065083516 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a74070e70 0x7f9a74151150 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:35:40.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.436+0000 7f9a7b0a2640 1 -- 172.21.15.43:0/3065083516 >> 172.21.15.43:0/3065083516 conn(0x7f9a74068d00 msgr2=0x7f9a74149d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:35:40.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.436+0000 7f9a7b0a2640 1 -- 172.21.15.43:0/3065083516 shutdown_connections 2024-09-17T04:35:40.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:35:40.436+0000 7f9a7b0a2640 1 -- 172.21.15.43:0/3065083516 wait complete. 2024-09-17T04:35:40.453 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-17T04:35:40.453 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-17T04:35:49.533 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:35:49.536 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:36:00.453 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-17T04:36:00.453 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T04:36:00.454 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T04:36:00.457 INFO:tasks.ceph.mon.c:Started 2024-09-17T04:36:00.457 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-17T04:36:00.457 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-17T04:36:00.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.629+0000 7fb5d7b8a640 1 -- 172.21.15.43:0/3941075239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5d00c69b0 msgr2=0x7fb5d01672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:00.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.629+0000 7fb5d7b8a640 1 --2- 172.21.15.43:0/3941075239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5d00c69b0 0x7fb5d01672e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00c80b0 tx=0x7fb5c802a920 comp rx=0 tx=0).stop 2024-09-17T04:36:00.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.629+0000 7fb5d7b8a640 1 -- 172.21.15.43:0/3941075239 shutdown_connections 2024-09-17T04:36:00.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.629+0000 7fb5d7b8a640 1 --2- 172.21.15.43:0/3941075239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5d00c69b0 0x7fb5d01672e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:00.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.630+0000 7fb5d7b8a640 1 -- 172.21.15.43:0/3941075239 >> 172.21.15.43:0/3941075239 conn(0x7fb5d006f460 msgr2=0x7fb5d006f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:00.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.630+0000 7fb5d7b8a640 1 -- 172.21.15.43:0/3941075239 shutdown_connections 2024-09-17T04:36:00.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.630+0000 7fb5d7b8a640 1 -- 172.21.15.43:0/3941075239 wait complete. 2024-09-17T04:36:00.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.632+0000 7fb5d7b8a640 1 Processor -- start 2024-09-17T04:36:00.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.633+0000 7fb5d7b8a640 1 -- start start 2024-09-17T04:36:00.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d7b8a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5d00c69b0 0x7fb5d01f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:00.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d7b8a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5d00c6f00 0x7fb5d01f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:00.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d7b8a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5d0155d40 0x7fb5d015de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:00.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d7b8a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d00c7730 con 0x7fb5d00c6f00 2024-09-17T04:36:00.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d7b8a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d00c7aa0 con 0x7fb5d0155d40 2024-09-17T04:36:00.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d7b8a640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d00b4d50 con 0x7fb5d00c69b0 2024-09-17T04:36:00.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d5125640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5d00c6f00 0x7fb5d01f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:00.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d5125640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5d00c6f00 0x7fb5d01f2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37788/0 (socket says 172.21.15.43:37788) 2024-09-17T04:36:00.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d5125640 1 -- 172.21.15.43:0/3633969082 learned_addr learned my addr 172.21.15.43:0/3633969082 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:36:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d5926640 1 --2- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5d00c69b0 0x7fb5d01f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d6127640 1 --2- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5d0155d40 0x7fb5d015de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d5926640 1 -- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5d00c69b0 msgr2=0x7fb5d01f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-17T04:36:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d5926640 1 -- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5d00c69b0 msgr2=0x7fb5d01f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T04:36:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d5926640 1 --2- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5d00c69b0 0x7fb5d01f6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T04:36:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d5926640 1 --2- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5d00c69b0 0x7fb5d01f6120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:36:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d6127640 1 -- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5d00c69b0 msgr2=0x7fb5d01f6120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:36:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d6127640 1 --2- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5d00c69b0 0x7fb5d01f6120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d6127640 1 -- 172.21.15.43:0/3633969082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5d00c6f00 msgr2=0x7fb5d01f2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d6127640 1 --2- 172.21.15.43:0/3633969082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5d00c6f00 0x7fb5d01f2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.635+0000 7fb5d6127640 1 -- 172.21.15.43:0/3633969082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d01f6660 con 0x7fb5d0155d40 2024-09-17T04:36:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.636+0000 7fb5d5125640 1 --2- 172.21.15.43:0/3633969082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5d00c6f00 0x7fb5d01f2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:36:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.636+0000 7fb5d6127640 1 --2- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5d0155d40 0x7fb5d015de70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009000 tx=0x7fb5c8003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.636+0000 7fb5c67fc640 1 -- 172.21.15.43:0/3633969082 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8030c50 con 0x7fb5d0155d40 2024-09-17T04:36:00.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.636+0000 7fb5c67fc640 1 -- 172.21.15.43:0/3633969082 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5c803e070 con 0x7fb5d0155d40 2024-09-17T04:36:00.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.636+0000 7fb5c67fc640 1 -- 172.21.15.43:0/3633969082 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8032330 con 0x7fb5d0155d40 2024-09-17T04:36:00.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.636+0000 7fb5d7b8a640 1 -- 172.21.15.43:0/3633969082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d0154b80 con 0x7fb5d0155d40 2024-09-17T04:36:00.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.636+0000 7fb5d7b8a640 1 -- 172.21.15.43:0/3633969082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d0155140 con 0x7fb5d0155d40 2024-09-17T04:36:00.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.637+0000 7fb5d7b8a640 1 -- 172.21.15.43:0/3633969082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5d00b4fc0 con 0x7fb5d0155d40 2024-09-17T04:36:00.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.639+0000 7fb5c67fc640 1 -- 172.21.15.43:0/3633969082 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb5c80324d0 con 0x7fb5d0155d40 2024-09-17T04:36:00.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.640+0000 7fb5c67fc640 1 --2- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fb5b4078b90 0x7fb5b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:00.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.640+0000 7fb5d5926640 1 --2- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fb5b4078b90 0x7fb5b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:00.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.640+0000 7fb5c67fc640 1 -- 172.21.15.43:0/3633969082 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5833+0+0 (secure 0 0 0) 0x7fb5c80bc530 con 0x7fb5d0155d40 2024-09-17T04:36:00.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.641+0000 7fb5d5926640 1 --2- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fb5b4078b90 0x7fb5b407b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc007b20 tx=0x7fb5cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:00.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.645+0000 7fb5c67fc640 1 -- 172.21.15.43:0/3633969082 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb5d00b4fc0 con 0x7fb5d0155d40 2024-09-17T04:36:00.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.906+0000 7fb5d7b8a640 1 -- 172.21.15.43:0/3633969082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb5d00b61e0 con 0x7fb5d0155d40 2024-09-17T04:36:00.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.906+0000 7fb5c67fc640 1 -- 172.21.15.43:0/3633969082 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7fb5d00b61e0 con 0x7fb5d0155d40 2024-09-17T04:36:00.907 INFO:teuthology.orchestra.run.smithi043.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","modified":"2024-09-17T04:33:51.199044Z","created":"2024-09-17T04:33:51.199044Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3301","nonce":0},{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-17T04:36:00.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.909+0000 7fb5d7b8a640 1 -- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fb5b4078b90 msgr2=0x7fb5b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:00.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.909+0000 7fb5d7b8a640 1 --2- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fb5b4078b90 0x7fb5b407b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc007b20 tx=0x7fb5cc009040 comp rx=0 tx=0).stop 2024-09-17T04:36:00.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.909+0000 7fb5d7b8a640 1 -- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5d0155d40 msgr2=0x7fb5d015de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:00.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.909+0000 7fb5d7b8a640 1 --2- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5d0155d40 0x7fb5d015de70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009000 tx=0x7fb5c8003ba0 comp rx=0 tx=0).stop 2024-09-17T04:36:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.909+0000 7fb5d7b8a640 1 -- 172.21.15.43:0/3633969082 shutdown_connections 2024-09-17T04:36:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.909+0000 7fb5d7b8a640 1 --2- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fb5b4078b90 0x7fb5b407b0a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.909+0000 7fb5d7b8a640 1 --2- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5d0155d40 0x7fb5d015de70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.909+0000 7fb5d7b8a640 1 --2- 172.21.15.43:0/3633969082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5d00c6f00 0x7fb5d01f2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.909+0000 7fb5d7b8a640 1 --2- 172.21.15.43:0/3633969082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5d00c69b0 0x7fb5d01f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.909+0000 7fb5d7b8a640 1 -- 172.21.15.43:0/3633969082 >> 172.21.15.43:0/3633969082 conn(0x7fb5d006f460 msgr2=0x7fb5d00b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.909+0000 7fb5d7b8a640 1 -- 172.21.15.43:0/3633969082 shutdown_connections 2024-09-17T04:36:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:00.909+0000 7fb5d7b8a640 1 -- 172.21.15.43:0/3633969082 wait complete. 2024-09-17T04:36:00.925 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-17T04:36:00.925 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-17T04:36:00.925 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-17T04:36:01.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.060+0000 7f6fef5df640 1 -- 172.21.15.43:0/1803860368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fd40040a0 msgr2=0x7f6fd4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.060+0000 7f6fef5df640 1 --2- 172.21.15.43:0/1803860368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fd40040a0 0x7f6fd4004800 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8005f10 tx=0x7f6fd4005830 comp rx=0 tx=0).stop 2024-09-17T04:36:01.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.060+0000 7f6fedb7c640 1 -- 172.21.15.43:0/1803860368 reap_dead start 2024-09-17T04:36:01.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.060+0000 7f6fef5df640 1 -- 172.21.15.43:0/1803860368 shutdown_connections 2024-09-17T04:36:01.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.060+0000 7f6fef5df640 1 -- 172.21.15.43:0/1803860368 >> 172.21.15.43:0/1803860368 conn(0x7f6fe80738e0 msgr2=0x7f6fe8073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:01.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.060+0000 7f6fef5df640 1 -- 172.21.15.43:0/1803860368 shutdown_connections 2024-09-17T04:36:01.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.060+0000 7f6fef5df640 1 -- 172.21.15.43:0/1803860368 wait complete. 2024-09-17T04:36:01.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.064+0000 7f6fef5df640 1 Processor -- start 2024-09-17T04:36:01.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.064+0000 7f6fef5df640 1 -- start start 2024-09-17T04:36:01.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.066+0000 7f6fef5df640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fd40040a0 0x7f6fe81edb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.066+0000 7f6fef5df640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6fe81e05e0 0x7f6fe814a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.066+0000 7f6fef5df640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fe814af20 0x7f6fe80c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.066+0000 7f6fef5df640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe8070c00 con 0x7f6fd40040a0 2024-09-17T04:36:01.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.066+0000 7f6fef5df640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe80c3dd0 con 0x7f6fe814af20 2024-09-17T04:36:01.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.066+0000 7f6fef5df640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe80b41e0 con 0x7f6fe81e05e0 2024-09-17T04:36:01.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.066+0000 7f6fed37b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fd40040a0 0x7f6fe81edb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.066+0000 7f6fed37b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fd40040a0 0x7f6fe81edb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37808/0 (socket says 172.21.15.43:37808) 2024-09-17T04:36:01.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.066+0000 7f6fed37b640 1 -- 172.21.15.43:0/99386748 learned_addr learned my addr 172.21.15.43:0/99386748 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:36:01.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.066+0000 7f6fecb7a640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6fe81e05e0 0x7f6fe814a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.066+0000 7f6fedb7c640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fe814af20 0x7f6fe80c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.067+0000 7f6fecb7a640 1 -- 172.21.15.43:0/99386748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fe814af20 msgr2=0x7f6fe80c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.067+0000 7f6fecb7a640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fe814af20 0x7f6fe80c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.067+0000 7f6fecb7a640 1 -- 172.21.15.43:0/99386748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fd40040a0 msgr2=0x7f6fe81edb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.067+0000 7f6fecb7a640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fd40040a0 0x7f6fe81edb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.067+0000 7f6fecb7a640 1 -- 172.21.15.43:0/99386748 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe81ee050 con 0x7f6fe81e05e0 2024-09-17T04:36:01.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.067+0000 7f6fecb7a640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6fe81e05e0 0x7f6fe814a9e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8037000 tx=0x7f6fd8003ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:01.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.067+0000 7f6fddffb640 1 -- 172.21.15.43:0/99386748 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd803b040 con 0x7f6fe81e05e0 2024-09-17T04:36:01.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.067+0000 7f6fddffb640 1 -- 172.21.15.43:0/99386748 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fd80142e0 con 0x7f6fe81e05e0 2024-09-17T04:36:01.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.067+0000 7f6fddffb640 1 -- 172.21.15.43:0/99386748 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd80406d0 con 0x7f6fe81e05e0 2024-09-17T04:36:01.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.067+0000 7f6fef5df640 1 -- 172.21.15.43:0/99386748 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe80c6a40 con 0x7f6fe81e05e0 2024-09-17T04:36:01.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.068+0000 7f6fef5df640 1 -- 172.21.15.43:0/99386748 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe814e470 con 0x7f6fe81e05e0 2024-09-17T04:36:01.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.069+0000 7f6fef5df640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe80c7480 0x7f6fe8150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.069+0000 7f6fef5df640 1 -- 172.21.15.43:0/99386748 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe80c6810 con 0x7f6fe80c7480 2024-09-17T04:36:01.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.069+0000 7f6fed37b640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe80c7480 0x7f6fe8150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.069+0000 7f6fed37b640 1 -- 172.21.15.43:0/99386748 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fe814b330 con 0x7f6fe80c7480 2024-09-17T04:36:01.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.069+0000 7f6fed37b640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe80c7480 0x7f6fe8150eb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4011a80 tx=0x7f6fe4011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:01.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.070+0000 7f6fddffb640 1 -- 172.21.15.43:0/99386748 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6fd8047060 con 0x7f6fe81e05e0 2024-09-17T04:36:01.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.070+0000 7f6fddffb640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f6fcc078b90 0x7f6fcc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.071+0000 7f6fddffb640 1 -- 172.21.15.43:0/99386748 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5833+0+0 (secure 0 0 0) 0x7f6fd80ba770 con 0x7f6fe81e05e0 2024-09-17T04:36:01.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.071+0000 7f6fedb7c640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f6fcc078b90 0x7f6fcc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.071+0000 7f6fddffb640 1 -- 172.21.15.43:0/99386748 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4010e60 con 0x7f6fe80c7480 2024-09-17T04:36:01.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.071+0000 7f6fddffb640 1 -- 172.21.15.43:0/99386748 <== mon.0 v2:172.21.15.43:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6fe4004020 con 0x7f6fe80c7480 2024-09-17T04:36:01.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.071+0000 7f6fddffb640 1 -- 172.21.15.43:0/99386748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe80c7480 msgr2=0x7f6fe8150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.071+0000 7f6fddffb640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe80c7480 0x7f6fe8150eb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4011a80 tx=0x7f6fe4011f40 comp rx=0 tx=0).stop 2024-09-17T04:36:01.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.071+0000 7f6fddffb640 1 -- 172.21.15.43:0/99386748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe80c7480 msgr2=0x7f6fe8150eb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:36:01.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.071+0000 7f6fddffb640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe80c7480 0x7f6fe8150eb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.071+0000 7f6fedb7c640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f6fcc078b90 0x7f6fcc07b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8076f40 tx=0x7f6fe0001f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:01.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.083+0000 7f6fef5df640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe80c7890 0x7f6fe81513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.083+0000 7f6fef5df640 1 -- 172.21.15.43:0/99386748 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe81f0960 con 0x7f6fe80c7890 2024-09-17T04:36:01.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.084+0000 7f6fed37b640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe80c7890 0x7f6fe81513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.084+0000 7f6fed37b640 1 -- 172.21.15.43:0/99386748 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6fe80cd870 con 0x7f6fe80c7890 2024-09-17T04:36:01.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.084+0000 7f6fed37b640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe80c7890 0x7f6fe81513f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4011a80 tx=0x7f6fe4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:01.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.084+0000 7f6fddffb640 1 -- 172.21.15.43:0/99386748 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe401e070 con 0x7f6fe80c7890 2024-09-17T04:36:01.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.085+0000 7f6fddffb640 1 -- 172.21.15.43:0/99386748 <== mon.0 v2:172.21.15.43:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5043 (secure 0 0 0) 0x7f6fe401f040 con 0x7f6fe80c7890 2024-09-17T04:36:01.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.085+0000 7f6fddffb640 1 -- 172.21.15.43:0/99386748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe80c7890 msgr2=0x7f6fe81513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.085+0000 7f6fddffb640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe80c7890 0x7f6fe81513f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4011a80 tx=0x7f6fe4004730 comp rx=0 tx=0).stop 2024-09-17T04:36:01.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.085+0000 7f6fddffb640 1 -- 172.21.15.43:0/99386748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe80c7890 msgr2=0x7f6fe81513f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:36:01.086 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-17T04:36:01.087 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "a", 2024-09-17T04:36:01.087 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 0, 2024-09-17T04:36:01.087 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "leader", 2024-09-17T04:36:01.087 INFO:teuthology.orchestra.run.smithi043.stdout: "election_epoch": 10, 2024-09-17T04:36:01.087 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 94826, 2024-09-17T04:36:01.087 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum": [ 2024-09-17T04:36:01.087 INFO:teuthology.orchestra.run.smithi043.stdout: 0, 2024-09-17T04:36:01.087 INFO:teuthology.orchestra.run.smithi043.stdout: 1, 2024-09-17T04:36:01.087 INFO:teuthology.orchestra.run.smithi043.stdout: 2 2024-09-17T04:36:01.087 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.087 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_age": 0, 2024-09-17T04:36:01.087 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:36:01.087 INFO:teuthology.orchestra.run.smithi043.stdout: "required_con": "2450521708007866372", 2024-09-17T04:36:01.088 INFO:teuthology.orchestra.run.smithi043.stdout: "required_mon": [ 2024-09-17T04:36:01.088 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:01.088 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:01.088 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:01.088 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:01.088 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:01.088 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:01.088 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:01.088 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:01.088 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:01.088 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:01.088 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:01.088 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.088 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_con": "4540719139924082687", 2024-09-17T04:36:01.088 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_mon": [ 2024-09-17T04:36:01.089 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:01.089 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:01.089 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:01.089 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:01.089 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:01.089 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:01.089 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:01.089 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:01.089 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:01.089 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:01.089 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:01.089 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.089 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.089 INFO:teuthology.orchestra.run.smithi043.stdout: "outside_quorum": [], 2024-09-17T04:36:01.090 INFO:teuthology.orchestra.run.smithi043.stdout: "extra_probe_peers": [], 2024-09-17T04:36:01.090 INFO:teuthology.orchestra.run.smithi043.stdout: "sync_provider": [], 2024-09-17T04:36:01.090 INFO:teuthology.orchestra.run.smithi043.stdout: "monmap": { 2024-09-17T04:36:01.090 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 1, 2024-09-17T04:36:01.090 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "cdef1e3e-07e6-43e6-b635-3ed1bc15d64a", 2024-09-17T04:36:01.090 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:36:01.090 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:36:01.090 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release": 19, 2024-09-17T04:36:01.090 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release_name": "squid", 2024-09-17T04:36:01.090 INFO:teuthology.orchestra.run.smithi043.stdout: "election_strategy": 1, 2024-09-17T04:36:01.090 INFO:teuthology.orchestra.run.smithi043.stdout: "disallowed_leaders: ": "", 2024-09-17T04:36:01.090 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false, 2024-09-17T04:36:01.090 INFO:teuthology.orchestra.run.smithi043.stdout: "tiebreaker_mon": "", 2024-09-17T04:36:01.090 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_ranks: ": "", 2024-09-17T04:36:01.090 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:36:01.091 INFO:teuthology.orchestra.run.smithi043.stdout: "persistent": [ 2024-09-17T04:36:01.091 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:01.091 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:01.091 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:01.091 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:01.091 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:01.091 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:01.091 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:01.091 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:01.091 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:01.091 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:01.091 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:01.091 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.091 INFO:teuthology.orchestra.run.smithi043.stdout: "optional": [] 2024-09-17T04:36:01.092 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.092 INFO:teuthology.orchestra.run.smithi043.stdout: "mons": [ 2024-09-17T04:36:01.092 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.092 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 0, 2024-09-17T04:36:01.092 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "a", 2024-09-17T04:36:01.092 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:01.092 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:01.092 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.092 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:01.092 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:3300", 2024-09-17T04:36:01.092 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.092 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.092 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.092 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:01.093 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789", 2024-09-17T04:36:01.093 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.093 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.093 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.093 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.093 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789/0", 2024-09-17T04:36:01.093 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.43:6789/0", 2024-09-17T04:36:01.093 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:01.093 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:01.093 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:01.093 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.093 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.093 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 1, 2024-09-17T04:36:01.094 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "b", 2024-09-17T04:36:01.094 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:01.094 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:01.094 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.094 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:01.094 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3300", 2024-09-17T04:36:01.094 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.094 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.094 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.094 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:01.094 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789", 2024-09-17T04:36:01.094 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.094 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.094 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.094 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.094 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789/0", 2024-09-17T04:36:01.095 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6789/0", 2024-09-17T04:36:01.095 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:01.095 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:01.095 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:01.095 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.095 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.095 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 2, 2024-09-17T04:36:01.095 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "c", 2024-09-17T04:36:01.095 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:01.095 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:01.095 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.095 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:01.095 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3301", 2024-09-17T04:36:01.095 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.095 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.096 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.096 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:01.096 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790", 2024-09-17T04:36:01.096 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.096 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.096 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.096 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.096 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790/0", 2024-09-17T04:36:01.096 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6790/0", 2024-09-17T04:36:01.096 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:01.096 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:01.096 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:01.096 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.096 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.097 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.097 INFO:teuthology.orchestra.run.smithi043.stdout: "feature_map": { 2024-09-17T04:36:01.097 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": [ 2024-09-17T04:36:01.097 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.097 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:01.097 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:01.097 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:36:01.097 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.097 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.097 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": [ 2024-09-17T04:36:01.097 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.098 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:01.098 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:01.098 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 5 2024-09-17T04:36:01.098 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.098 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.098 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": [ 2024-09-17T04:36:01.098 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.098 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:01.098 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:01.098 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 6 2024-09-17T04:36:01.099 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.099 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.099 INFO:teuthology.orchestra.run.smithi043.stdout: "client": [ 2024-09-17T04:36:01.099 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.099 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:01.099 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:01.099 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:36:01.099 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.099 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.099 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": [ 2024-09-17T04:36:01.099 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.099 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:01.099 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:01.099 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:36:01.100 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.100 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.100 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.100 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false 2024-09-17T04:36:01.100 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-17T04:36:01.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.085+0000 7f6fddffb640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe80c7890 0x7f6fe81513f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.085+0000 7f6fef5df640 1 -- 172.21.15.43:0/99386748 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f6fcc078b90 msgr2=0x7f6fcc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.085+0000 7f6fef5df640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f6fcc078b90 0x7f6fcc07b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8076f40 tx=0x7f6fe0001f30 comp rx=0 tx=0).stop 2024-09-17T04:36:01.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.085+0000 7f6fedb7c640 1 -- 172.21.15.43:0/99386748 reap_dead start 2024-09-17T04:36:01.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.085+0000 7f6fef5df640 1 -- 172.21.15.43:0/99386748 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6fe81e05e0 msgr2=0x7f6fe814a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.085+0000 7f6fef5df640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6fe81e05e0 0x7f6fe814a9e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8037000 tx=0x7f6fd8003ea0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.085+0000 7f6fef5df640 1 -- 172.21.15.43:0/99386748 shutdown_connections 2024-09-17T04:36:01.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.085+0000 7f6fef5df640 1 --2- 172.21.15.43:0/99386748 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6fe81e05e0 0x7f6fe814a9e0 secure :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8037000 tx=0x7f6fd8003ea0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.085+0000 7f6fef5df640 1 -- 172.21.15.43:0/99386748 >> 172.21.15.43:0/99386748 conn(0x7f6fe80738e0 msgr2=0x7f6fe80cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:01.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.086+0000 7f6fef5df640 1 -- 172.21.15.43:0/99386748 shutdown_connections 2024-09-17T04:36:01.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.086+0000 7f6fef5df640 1 -- 172.21.15.43:0/99386748 wait complete. 2024-09-17T04:36:01.102 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-17T04:36:01.103 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-17T04:36:01.103 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-17T04:36:01.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.229+0000 7fde37fff640 1 -- 172.21.15.43:0/2255202635 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3802d470 con 0x7fde401589e0 2024-09-17T04:36:01.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.229+0000 7fde478dc640 1 -- 172.21.15.43:0/2255202635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde401589e0 msgr2=0x7fde40158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.229+0000 7fde478dc640 1 --2- 172.21.15.43:0/2255202635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde401589e0 0x7fde40158df0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fde400cbab0 tx=0x7fde3802ab40 comp rx=0 tx=0).stop 2024-09-17T04:36:01.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.229+0000 7fde478dc640 1 -- 172.21.15.43:0/2255202635 shutdown_connections 2024-09-17T04:36:01.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.229+0000 7fde478dc640 1 --2- 172.21.15.43:0/2255202635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde401589e0 0x7fde40158df0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.229+0000 7fde478dc640 1 --2- 172.21.15.43:0/2255202635 >> v2:172.21.15.62:3300/0 conn(0x7fde400c2f40 0x7fde401525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.229+0000 7fde478dc640 1 -- 172.21.15.43:0/2255202635 >> 172.21.15.43:0/2255202635 conn(0x7fde400738e0 msgr2=0x7fde40073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:01.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.229+0000 7fde478dc640 1 -- 172.21.15.43:0/2255202635 shutdown_connections 2024-09-17T04:36:01.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.229+0000 7fde478dc640 1 -- 172.21.15.43:0/2255202635 wait complete. 2024-09-17T04:36:01.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.232+0000 7fde478dc640 1 Processor -- start 2024-09-17T04:36:01.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.232+0000 7fde478dc640 1 -- start start 2024-09-17T04:36:01.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.234+0000 7fde478dc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde4006e8a0 0x7fde401efff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.234+0000 7fde478dc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde400c2f40 0x7fde40143bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.234+0000 7fde478dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde401589e0 0x7fde40145580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.234+0000 7fde478dc640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fde40070c00 con 0x7fde400c2f40 2024-09-17T04:36:01.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.234+0000 7fde478dc640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fde40159330 con 0x7fde401589e0 2024-09-17T04:36:01.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.234+0000 7fde478dc640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fde400b41e0 con 0x7fde4006e8a0 2024-09-17T04:36:01.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.234+0000 7fde45e79640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde401589e0 0x7fde40145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.234+0000 7fde45678640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde4006e8a0 0x7fde401efff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.235+0000 7fde45e79640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde401589e0 0x7fde40145580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:47694/0 (socket says 172.21.15.43:47694) 2024-09-17T04:36:01.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.235+0000 7fde45e79640 1 -- 172.21.15.43:0/2792121924 learned_addr learned my addr 172.21.15.43:0/2792121924 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:36:01.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.235+0000 7fde45678640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde4006e8a0 0x7fde401efff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:41858/0 (socket says 172.21.15.43:41858) 2024-09-17T04:36:01.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.235+0000 7fde44e77640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde400c2f40 0x7fde40143bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.235+0000 7fde45678640 1 -- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde401589e0 msgr2=0x7fde40145580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.235+0000 7fde45678640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde401589e0 0x7fde40145580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.235+0000 7fde45678640 1 -- 172.21.15.43:0/2792121924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde400c2f40 msgr2=0x7fde40143bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.235+0000 7fde45678640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde400c2f40 0x7fde40143bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.235+0000 7fde45678640 1 -- 172.21.15.43:0/2792121924 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde40144100 con 0x7fde4006e8a0 2024-09-17T04:36:01.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.235+0000 7fde45e79640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde401589e0 0x7fde40145580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:36:01.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.235+0000 7fde45678640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde4006e8a0 0x7fde401efff0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00b9d0 tx=0x7fde3c00be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:01.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.235+0000 7fde35ffb640 1 -- 172.21.15.43:0/2792121924 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c016070 con 0x7fde4006e8a0 2024-09-17T04:36:01.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.235+0000 7fde35ffb640 1 -- 172.21.15.43:0/2792121924 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde3c009880 con 0x7fde4006e8a0 2024-09-17T04:36:01.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.236+0000 7fde478dc640 1 -- 172.21.15.43:0/2792121924 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde40150d80 con 0x7fde4006e8a0 2024-09-17T04:36:01.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.236+0000 7fde35ffb640 1 -- 172.21.15.43:0/2792121924 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c009cb0 con 0x7fde4006e8a0 2024-09-17T04:36:01.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.236+0000 7fde478dc640 1 -- 172.21.15.43:0/2792121924 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fde40150270 con 0x7fde4006e8a0 2024-09-17T04:36:01.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.237+0000 7fde478dc640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde4014e640 0x7fde40145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.237+0000 7fde478dc640 1 -- 172.21.15.43:0/2792121924 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fde40150b30 con 0x7fde4014e640 2024-09-17T04:36:01.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.237+0000 7fde44e77640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde4014e640 0x7fde40145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.238+0000 7fde44e77640 1 -- 172.21.15.43:0/2792121924 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde40151060 con 0x7fde4014e640 2024-09-17T04:36:01.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.238+0000 7fde35ffb640 1 -- 172.21.15.43:0/2792121924 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde3c005020 con 0x7fde4006e8a0 2024-09-17T04:36:01.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.238+0000 7fde44e77640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde4014e640 0x7fde40145ac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fde40155fc0 tx=0x7fde3000f9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:01.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.238+0000 7fde35ffb640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fde24078b90 0x7fde2407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.239+0000 7fde35ffb640 1 -- 172.21.15.43:0/2792121924 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5833+0+0 (secure 0 0 0) 0x7fde3c09aa00 con 0x7fde4006e8a0 2024-09-17T04:36:01.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.239+0000 7fde35ffb640 1 -- 172.21.15.43:0/2792121924 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30019070 con 0x7fde4014e640 2024-09-17T04:36:01.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.239+0000 7fde35ffb640 1 -- 172.21.15.43:0/2792121924 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fde30005320 con 0x7fde4014e640 2024-09-17T04:36:01.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.239+0000 7fde35ffb640 1 -- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde4014e640 msgr2=0x7fde40145ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.239+0000 7fde35ffb640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde4014e640 0x7fde40145ac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fde40155fc0 tx=0x7fde3000f9d0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.239+0000 7fde35ffb640 1 -- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde4014e640 msgr2=0x7fde40145ac0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:36:01.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.239+0000 7fde35ffb640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde4014e640 0x7fde40145ac0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.239+0000 7fde45e79640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fde24078b90 0x7fde2407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.240+0000 7fde45e79640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fde24078b90 0x7fde2407b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fde380094e0 tx=0x7fde38042040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:01.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.251+0000 7fde478dc640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde401f0530 0x7fde401f3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.251+0000 7fde478dc640 1 -- 172.21.15.43:0/2792121924 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fde40165e80 con 0x7fde401f0530 2024-09-17T04:36:01.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.251+0000 7fde44e77640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde401f0530 0x7fde401f3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.252+0000 7fde44e77640 1 -- 172.21.15.43:0/2792121924 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fde400c8610 con 0x7fde401f0530 2024-09-17T04:36:01.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.252+0000 7fde44e77640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde401f0530 0x7fde401f3560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fde30016000 tx=0x7fde30000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:01.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.252+0000 7fde35ffb640 1 -- 172.21.15.43:0/2792121924 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30019030 con 0x7fde401f0530 2024-09-17T04:36:01.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.252+0000 7fde35ffb640 1 -- 172.21.15.43:0/2792121924 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5184 (secure 0 0 0) 0x7fde30006c70 con 0x7fde401f0530 2024-09-17T04:36:01.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.252+0000 7fde35ffb640 1 -- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde401f0530 msgr2=0x7fde401f3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.252+0000 7fde35ffb640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde401f0530 0x7fde401f3560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fde30016000 tx=0x7fde30000ed0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.252+0000 7fde35ffb640 1 -- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde401f0530 msgr2=0x7fde401f3560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:36:01.254 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-17T04:36:01.254 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "b", 2024-09-17T04:36:01.254 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 1, 2024-09-17T04:36:01.254 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "peon", 2024-09-17T04:36:01.254 INFO:teuthology.orchestra.run.smithi043.stdout: "election_epoch": 10, 2024-09-17T04:36:01.254 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 94958, 2024-09-17T04:36:01.255 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum": [ 2024-09-17T04:36:01.255 INFO:teuthology.orchestra.run.smithi043.stdout: 0, 2024-09-17T04:36:01.255 INFO:teuthology.orchestra.run.smithi043.stdout: 1, 2024-09-17T04:36:01.255 INFO:teuthology.orchestra.run.smithi043.stdout: 2 2024-09-17T04:36:01.255 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.255 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_age": 0, 2024-09-17T04:36:01.255 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:36:01.255 INFO:teuthology.orchestra.run.smithi043.stdout: "required_con": "2450521708007866372", 2024-09-17T04:36:01.255 INFO:teuthology.orchestra.run.smithi043.stdout: "required_mon": [ 2024-09-17T04:36:01.255 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:01.255 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:01.255 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:01.255 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:01.256 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:01.256 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:01.256 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:01.256 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:01.256 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:01.256 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:01.256 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:01.256 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.256 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_con": "4540719139924082687", 2024-09-17T04:36:01.256 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_mon": [ 2024-09-17T04:36:01.256 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:01.256 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:01.256 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:01.256 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:01.257 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:01.257 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:01.257 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:01.257 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:01.257 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:01.257 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:01.257 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:01.257 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.257 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.257 INFO:teuthology.orchestra.run.smithi043.stdout: "outside_quorum": [], 2024-09-17T04:36:01.257 INFO:teuthology.orchestra.run.smithi043.stdout: "extra_probe_peers": [], 2024-09-17T04:36:01.257 INFO:teuthology.orchestra.run.smithi043.stdout: "sync_provider": [], 2024-09-17T04:36:01.257 INFO:teuthology.orchestra.run.smithi043.stdout: "monmap": { 2024-09-17T04:36:01.258 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 1, 2024-09-17T04:36:01.258 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "cdef1e3e-07e6-43e6-b635-3ed1bc15d64a", 2024-09-17T04:36:01.258 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:36:01.258 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:36:01.258 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release": 19, 2024-09-17T04:36:01.258 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release_name": "squid", 2024-09-17T04:36:01.258 INFO:teuthology.orchestra.run.smithi043.stdout: "election_strategy": 1, 2024-09-17T04:36:01.258 INFO:teuthology.orchestra.run.smithi043.stdout: "disallowed_leaders: ": "", 2024-09-17T04:36:01.258 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false, 2024-09-17T04:36:01.258 INFO:teuthology.orchestra.run.smithi043.stdout: "tiebreaker_mon": "", 2024-09-17T04:36:01.258 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_ranks: ": "", 2024-09-17T04:36:01.258 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:36:01.259 INFO:teuthology.orchestra.run.smithi043.stdout: "persistent": [ 2024-09-17T04:36:01.259 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:01.259 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:01.259 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:01.259 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:01.259 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:01.259 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:01.259 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:01.259 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:01.259 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:01.259 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:01.259 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:01.259 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.259 INFO:teuthology.orchestra.run.smithi043.stdout: "optional": [] 2024-09-17T04:36:01.260 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.260 INFO:teuthology.orchestra.run.smithi043.stdout: "mons": [ 2024-09-17T04:36:01.260 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.260 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 0, 2024-09-17T04:36:01.260 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "a", 2024-09-17T04:36:01.260 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:01.260 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:01.260 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.260 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:01.260 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:3300", 2024-09-17T04:36:01.260 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.260 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.260 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.261 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:01.261 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789", 2024-09-17T04:36:01.261 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.261 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.261 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.261 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.261 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789/0", 2024-09-17T04:36:01.261 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.43:6789/0", 2024-09-17T04:36:01.261 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:01.261 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:01.261 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:01.261 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.261 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.262 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 1, 2024-09-17T04:36:01.262 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "b", 2024-09-17T04:36:01.262 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:01.262 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:01.262 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.262 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:01.262 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3300", 2024-09-17T04:36:01.262 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.262 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.262 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.262 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:01.262 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789", 2024-09-17T04:36:01.262 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.262 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.263 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.263 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.263 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789/0", 2024-09-17T04:36:01.263 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6789/0", 2024-09-17T04:36:01.263 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:01.263 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:01.263 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:01.263 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.263 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.263 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 2, 2024-09-17T04:36:01.263 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "c", 2024-09-17T04:36:01.263 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:01.263 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:01.263 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.263 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:01.264 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3301", 2024-09-17T04:36:01.264 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.264 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.264 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.264 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:01.264 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790", 2024-09-17T04:36:01.264 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.264 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.264 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.264 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.264 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790/0", 2024-09-17T04:36:01.264 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6790/0", 2024-09-17T04:36:01.264 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:01.265 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:01.265 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:01.265 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.265 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.265 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.265 INFO:teuthology.orchestra.run.smithi043.stdout: "feature_map": { 2024-09-17T04:36:01.265 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": [ 2024-09-17T04:36:01.265 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.265 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:01.265 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:01.265 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:36:01.265 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.265 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.265 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": [ 2024-09-17T04:36:01.266 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.266 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:01.266 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:01.266 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:36:01.266 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.266 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.266 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": [ 2024-09-17T04:36:01.266 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.266 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:01.266 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:01.266 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 2 2024-09-17T04:36:01.266 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.266 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.266 INFO:teuthology.orchestra.run.smithi043.stdout: "client": [ 2024-09-17T04:36:01.267 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.267 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-17T04:36:01.267 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "luminous", 2024-09-17T04:36:01.267 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:36:01.267 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.267 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.267 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:01.267 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:01.267 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 5 2024-09-17T04:36:01.267 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.267 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.267 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": [ 2024-09-17T04:36:01.267 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.267 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:01.267 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:01.268 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:36:01.268 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.268 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.268 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.268 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false 2024-09-17T04:36:01.268 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-17T04:36:01.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.252+0000 7fde35ffb640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde401f0530 0x7fde401f3560 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.253+0000 7fde478dc640 1 -- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fde24078b90 msgr2=0x7fde2407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.253+0000 7fde478dc640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fde24078b90 0x7fde2407b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fde380094e0 tx=0x7fde38042040 comp rx=0 tx=0).stop 2024-09-17T04:36:01.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.253+0000 7fde45e79640 1 -- 172.21.15.43:0/2792121924 reap_dead start 2024-09-17T04:36:01.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.253+0000 7fde478dc640 1 -- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde4006e8a0 msgr2=0x7fde401efff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.253+0000 7fde478dc640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde4006e8a0 0x7fde401efff0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00b9d0 tx=0x7fde3c00be90 comp rx=0 tx=0).stop 2024-09-17T04:36:01.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.253+0000 7fde478dc640 1 -- 172.21.15.43:0/2792121924 shutdown_connections 2024-09-17T04:36:01.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.253+0000 7fde478dc640 1 --2- 172.21.15.43:0/2792121924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde4006e8a0 0x7fde401efff0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.253+0000 7fde478dc640 1 -- 172.21.15.43:0/2792121924 >> 172.21.15.43:0/2792121924 conn(0x7fde400738e0 msgr2=0x7fde4014c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:01.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.254+0000 7fde478dc640 1 -- 172.21.15.43:0/2792121924 shutdown_connections 2024-09-17T04:36:01.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.254+0000 7fde478dc640 1 -- 172.21.15.43:0/2792121924 wait complete. 2024-09-17T04:36:01.271 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-17T04:36:01.271 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-17T04:36:01.271 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-17T04:36:01.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.395+0000 7fdfd4332640 1 -- 172.21.15.43:0/511681934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfcc1535e0 msgr2=0x7fdfcc0c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.395+0000 7fdfd4332640 1 --2- 172.21.15.43:0/511681934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfcc1535e0 0x7fdfcc0c6910 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8005fd0 tx=0x7fdfc802a670 comp rx=0 tx=0).stop 2024-09-17T04:36:01.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.395+0000 7fdfd4332640 1 -- 172.21.15.43:0/511681934 shutdown_connections 2024-09-17T04:36:01.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.395+0000 7fdfd4332640 1 --2- 172.21.15.43:0/511681934 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc1539f0 0x7fdfcc0c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.395+0000 7fdfd4332640 1 --2- 172.21.15.43:0/511681934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfcc1535e0 0x7fdfcc0c6910 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.395+0000 7fdfd4332640 1 -- 172.21.15.43:0/511681934 >> 172.21.15.43:0/511681934 conn(0x7fdfcc0738e0 msgr2=0x7fdfcc073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:01.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.395+0000 7fdfd4332640 1 -- 172.21.15.43:0/511681934 shutdown_connections 2024-09-17T04:36:01.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.395+0000 7fdfd4332640 1 -- 172.21.15.43:0/511681934 wait complete. 2024-09-17T04:36:01.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.397+0000 7fdfd4332640 1 Processor -- start 2024-09-17T04:36:01.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.397+0000 7fdfd4332640 1 -- start start 2024-09-17T04:36:01.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.398+0000 7fdfd4332640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfcc0c7570 0x7fdfcc06e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.398+0000 7fdfd4332640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfcc1535e0 0x7fdfcc147780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.398+0000 7fdfd4332640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc1539f0 0x7fdfcc147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.398+0000 7fdfd4332640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc159650 con 0x7fdfcc0c7570 2024-09-17T04:36:01.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.398+0000 7fdfd4332640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc0c6110 con 0x7fdfcc1535e0 2024-09-17T04:36:01.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.398+0000 7fdfd4332640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdfcc0c5420 con 0x7fdfcc1539f0 2024-09-17T04:36:01.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.398+0000 7fdfd20ce640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfcc0c7570 0x7fdfcc06e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.398+0000 7fdfd20ce640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfcc0c7570 0x7fdfcc06e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37882/0 (socket says 172.21.15.43:37882) 2024-09-17T04:36:01.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.398+0000 7fdfd20ce640 1 -- 172.21.15.43:0/670466895 learned_addr learned my addr 172.21.15.43:0/670466895 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:36:01.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.398+0000 7fdfd18cd640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfcc1535e0 0x7fdfcc147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.399+0000 7fdfd28cf640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc1539f0 0x7fdfcc147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.399+0000 7fdfd20ce640 1 -- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc1539f0 msgr2=0x7fdfcc147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.399+0000 7fdfd20ce640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc1539f0 0x7fdfcc147cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.399+0000 7fdfd20ce640 1 -- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfcc1535e0 msgr2=0x7fdfcc147780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.399+0000 7fdfd20ce640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfcc1535e0 0x7fdfcc147780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.399+0000 7fdfd20ce640 1 -- 172.21.15.43:0/670466895 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfcc06eaa0 con 0x7fdfcc0c7570 2024-09-17T04:36:01.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.399+0000 7fdfd20ce640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfcc0c7570 0x7fdfcc06e560 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8034040 tx=0x7fdfc80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:01.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.399+0000 7fdfc2ffd640 1 -- 172.21.15.43:0/670466895 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc803e030 con 0x7fdfcc0c7570 2024-09-17T04:36:01.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.399+0000 7fdfc2ffd640 1 -- 172.21.15.43:0/670466895 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfc8003d90 con 0x7fdfcc0c7570 2024-09-17T04:36:01.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.399+0000 7fdfc2ffd640 1 -- 172.21.15.43:0/670466895 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8035040 con 0x7fdfcc0c7570 2024-09-17T04:36:01.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.400+0000 7fdfd4332640 1 -- 172.21.15.43:0/670466895 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfcc1f04f0 con 0x7fdfcc0c7570 2024-09-17T04:36:01.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.400+0000 7fdfd4332640 1 -- 172.21.15.43:0/670466895 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfcc06fa70 con 0x7fdfcc0c7570 2024-09-17T04:36:01.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.401+0000 7fdfd4332640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc0708b0 0x7fdfcc1e13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.401+0000 7fdfd4332640 1 -- 172.21.15.43:0/670466895 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdfcc0c4f50 con 0x7fdfcc0708b0 2024-09-17T04:36:01.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.402+0000 7fdfd18cd640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc0708b0 0x7fdfcc1e13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.402+0000 7fdfd18cd640 1 -- 172.21.15.43:0/670466895 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdfcc0b3ed0 con 0x7fdfcc0708b0 2024-09-17T04:36:01.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.402+0000 7fdfd18cd640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc0708b0 0x7fdfcc1e13e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc075010 tx=0x7fdfbc010e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:01.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.402+0000 7fdfc2ffd640 1 -- 172.21.15.43:0/670466895 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdfc8041030 con 0x7fdfcc0c7570 2024-09-17T04:36:01.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.403+0000 7fdfc2ffd640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fdfb0078bc0 0x7fdfb007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.404+0000 7fdfc2ffd640 1 -- 172.21.15.43:0/670466895 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5833+0+0 (secure 0 0 0) 0x7fdfc80bb3a0 con 0x7fdfcc0c7570 2024-09-17T04:36:01.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.404+0000 7fdfd28cf640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fdfb0078bc0 0x7fdfb007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.404+0000 7fdfc2ffd640 1 -- 172.21.15.43:0/670466895 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc00ed80 con 0x7fdfcc0708b0 2024-09-17T04:36:01.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.404+0000 7fdfc2ffd640 1 -- 172.21.15.43:0/670466895 <== mon.2 v2:172.21.15.62:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdfbc005020 con 0x7fdfcc0708b0 2024-09-17T04:36:01.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.404+0000 7fdfc2ffd640 1 -- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc0708b0 msgr2=0x7fdfcc1e13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.404+0000 7fdfd28cf640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fdfb0078bc0 0x7fdfb007b0d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40012e0 tx=0x7fdfc400e5a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:01.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.404+0000 7fdfc2ffd640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc0708b0 0x7fdfcc1e13e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc075010 tx=0x7fdfbc010e00 comp rx=0 tx=0).stop 2024-09-17T04:36:01.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.404+0000 7fdfc2ffd640 1 -- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc0708b0 msgr2=0x7fdfcc1e13e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:36:01.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.404+0000 7fdfc2ffd640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc0708b0 0x7fdfcc1e13e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.416+0000 7fdfd4332640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc06ec70 0x7fdfcc1e1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.417+0000 7fdfd4332640 1 -- 172.21.15.43:0/670466895 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdfcc1e1e60 con 0x7fdfcc06ec70 2024-09-17T04:36:01.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.417+0000 7fdfd18cd640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc06ec70 0x7fdfcc1e1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.417+0000 7fdfd18cd640 1 -- 172.21.15.43:0/670466895 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdfcc073d90 con 0x7fdfcc06ec70 2024-09-17T04:36:01.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.417+0000 7fdfd18cd640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc06ec70 0x7fdfcc1e1920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc075010 tx=0x7fdfbc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:01.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.418+0000 7fdfc2ffd640 1 -- 172.21.15.43:0/670466895 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc004020 con 0x7fdfcc06ec70 2024-09-17T04:36:01.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.418+0000 7fdfc2ffd640 1 -- 172.21.15.43:0/670466895 <== mon.2 v2:172.21.15.62:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4538 (secure 0 0 0) 0x7fdfbc020570 con 0x7fdfcc06ec70 2024-09-17T04:36:01.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.418+0000 7fdfc2ffd640 1 -- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc06ec70 msgr2=0x7fdfcc1e1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.418+0000 7fdfc2ffd640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc06ec70 0x7fdfcc1e1920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc075010 tx=0x7fdfbc0046c0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.418+0000 7fdfc2ffd640 1 -- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc06ec70 msgr2=0x7fdfcc1e1920 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:36:01.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.418+0000 7fdfc2ffd640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfcc06ec70 0x7fdfcc1e1920 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.420 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-17T04:36:01.420 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "c", 2024-09-17T04:36:01.420 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 2, 2024-09-17T04:36:01.420 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "peon", 2024-09-17T04:36:01.420 INFO:teuthology.orchestra.run.smithi043.stdout: "election_epoch": 10, 2024-09-17T04:36:01.420 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 852, 2024-09-17T04:36:01.420 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum": [ 2024-09-17T04:36:01.420 INFO:teuthology.orchestra.run.smithi043.stdout: 0, 2024-09-17T04:36:01.421 INFO:teuthology.orchestra.run.smithi043.stdout: 1, 2024-09-17T04:36:01.421 INFO:teuthology.orchestra.run.smithi043.stdout: 2 2024-09-17T04:36:01.421 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.421 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_age": 0, 2024-09-17T04:36:01.421 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:36:01.421 INFO:teuthology.orchestra.run.smithi043.stdout: "required_con": "2450521708007866372", 2024-09-17T04:36:01.421 INFO:teuthology.orchestra.run.smithi043.stdout: "required_mon": [ 2024-09-17T04:36:01.421 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:01.421 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:01.421 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:01.421 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:01.421 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:01.421 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:01.422 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:01.422 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:01.422 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:01.422 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:01.422 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:01.422 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.422 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_con": "4540719139924082687", 2024-09-17T04:36:01.422 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_mon": [ 2024-09-17T04:36:01.422 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:01.422 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:01.422 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:01.422 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:01.422 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:01.423 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:01.423 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:01.423 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:01.423 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:01.423 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:01.423 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:01.423 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.423 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.423 INFO:teuthology.orchestra.run.smithi043.stdout: "outside_quorum": [], 2024-09-17T04:36:01.423 INFO:teuthology.orchestra.run.smithi043.stdout: "extra_probe_peers": [], 2024-09-17T04:36:01.423 INFO:teuthology.orchestra.run.smithi043.stdout: "sync_provider": [], 2024-09-17T04:36:01.423 INFO:teuthology.orchestra.run.smithi043.stdout: "monmap": { 2024-09-17T04:36:01.423 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 1, 2024-09-17T04:36:01.423 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "cdef1e3e-07e6-43e6-b635-3ed1bc15d64a", 2024-09-17T04:36:01.424 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:36:01.424 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:36:01.424 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release": 19, 2024-09-17T04:36:01.424 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release_name": "squid", 2024-09-17T04:36:01.424 INFO:teuthology.orchestra.run.smithi043.stdout: "election_strategy": 1, 2024-09-17T04:36:01.424 INFO:teuthology.orchestra.run.smithi043.stdout: "disallowed_leaders: ": "", 2024-09-17T04:36:01.424 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false, 2024-09-17T04:36:01.424 INFO:teuthology.orchestra.run.smithi043.stdout: "tiebreaker_mon": "", 2024-09-17T04:36:01.424 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_ranks: ": "", 2024-09-17T04:36:01.424 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:36:01.424 INFO:teuthology.orchestra.run.smithi043.stdout: "persistent": [ 2024-09-17T04:36:01.424 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:01.425 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:01.425 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:01.425 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:01.425 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:01.425 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:01.425 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:01.425 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:01.425 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:01.425 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:01.425 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:01.425 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.425 INFO:teuthology.orchestra.run.smithi043.stdout: "optional": [] 2024-09-17T04:36:01.425 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.426 INFO:teuthology.orchestra.run.smithi043.stdout: "mons": [ 2024-09-17T04:36:01.426 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.426 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 0, 2024-09-17T04:36:01.426 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "a", 2024-09-17T04:36:01.426 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:01.426 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:01.426 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.426 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:01.426 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:3300", 2024-09-17T04:36:01.426 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.426 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.426 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.426 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:01.427 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789", 2024-09-17T04:36:01.427 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.427 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.427 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.427 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.427 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789/0", 2024-09-17T04:36:01.427 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.43:6789/0", 2024-09-17T04:36:01.427 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:01.427 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:01.427 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:01.427 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.427 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.427 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 1, 2024-09-17T04:36:01.428 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "b", 2024-09-17T04:36:01.428 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:01.428 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:01.428 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.428 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:01.428 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3300", 2024-09-17T04:36:01.428 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.428 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.428 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.428 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:01.428 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789", 2024-09-17T04:36:01.428 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.428 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.428 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.429 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.429 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789/0", 2024-09-17T04:36:01.429 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6789/0", 2024-09-17T04:36:01.429 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:01.429 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:01.429 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:01.429 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.429 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.429 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 2, 2024-09-17T04:36:01.429 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "c", 2024-09-17T04:36:01.429 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:01.429 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:01.430 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.430 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:01.430 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3301", 2024-09-17T04:36:01.430 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.430 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.430 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.430 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:01.430 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790", 2024-09-17T04:36:01.430 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:01.430 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.430 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.430 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.430 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790/0", 2024-09-17T04:36:01.430 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6790/0", 2024-09-17T04:36:01.431 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:01.431 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:01.431 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:01.431 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.431 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.431 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.431 INFO:teuthology.orchestra.run.smithi043.stdout: "feature_map": { 2024-09-17T04:36:01.431 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": [ 2024-09-17T04:36:01.431 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.431 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:01.431 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:01.431 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:36:01.431 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.432 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:01.432 INFO:teuthology.orchestra.run.smithi043.stdout: "client": [ 2024-09-17T04:36:01.432 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:01.432 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:01.432 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:01.432 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:36:01.432 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:01.432 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:01.432 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:01.432 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false 2024-09-17T04:36:01.432 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-17T04:36:01.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.418+0000 7fdfd4332640 1 -- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fdfb0078bc0 msgr2=0x7fdfb007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.418+0000 7fdfd4332640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fdfb0078bc0 0x7fdfb007b0d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40012e0 tx=0x7fdfc400e5a0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.418+0000 7fdfd4332640 1 -- 172.21.15.43:0/670466895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfcc0c7570 msgr2=0x7fdfcc06e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.418+0000 7fdfd4332640 1 --2- 172.21.15.43:0/670466895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfcc0c7570 0x7fdfcc06e560 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8034040 tx=0x7fdfc80038a0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.418+0000 7fdfd28cf640 1 -- 172.21.15.43:0/670466895 reap_dead start 2024-09-17T04:36:01.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.418+0000 7fdfd28cf640 1 -- 172.21.15.43:0/670466895 reap_dead start 2024-09-17T04:36:01.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.418+0000 7fdfd4332640 1 -- 172.21.15.43:0/670466895 shutdown_connections 2024-09-17T04:36:01.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.418+0000 7fdfd4332640 1 -- 172.21.15.43:0/670466895 >> 172.21.15.43:0/670466895 conn(0x7fdfcc0738e0 msgr2=0x7fdfcc1521b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:01.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.419+0000 7fdfd4332640 1 -- 172.21.15.43:0/670466895 shutdown_connections 2024-09-17T04:36:01.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.419+0000 7fdfd4332640 1 -- 172.21.15.43:0/670466895 wait complete. 2024-09-17T04:36:01.435 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-17T04:36:01.435 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-17T04:36:01.435 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-17T04:36:01.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.555+0000 7feed0840640 1 -- 172.21.15.43:0/2567534823 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feecc0c6e50 msgr2=0x7feecc0c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.555+0000 7feed0840640 1 --2- 172.21.15.43:0/2567534823 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feecc0c6e50 0x7feecc0c7c80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7feec4005fd0 tx=0x7feec402a8e0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.556+0000 7feed0840640 1 -- 172.21.15.43:0/2567534823 shutdown_connections 2024-09-17T04:36:01.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.556+0000 7feed0840640 1 --2- 172.21.15.43:0/2567534823 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feecc0c6e50 0x7feecc0c7c80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.556+0000 7feed0840640 1 --2- 172.21.15.43:0/2567534823 >> v2:172.21.15.62:3300/0 conn(0x7feecc1535e0 0x7feecc0c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.556+0000 7feed0840640 1 -- 172.21.15.43:0/2567534823 >> 172.21.15.43:0/2567534823 conn(0x7feecc0738e0 msgr2=0x7feecc073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:01.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.556+0000 7feed0840640 1 -- 172.21.15.43:0/2567534823 shutdown_connections 2024-09-17T04:36:01.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.556+0000 7feed0840640 1 -- 172.21.15.43:0/2567534823 wait complete. 2024-09-17T04:36:01.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.559+0000 7feed0840640 1 Processor -- start 2024-09-17T04:36:01.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.559+0000 7feed0840640 1 -- start start 2024-09-17T04:36:01.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.561+0000 7feed0840640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feecc0c6e50 0x7feecc1efba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.561+0000 7feed0840640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feecc1535e0 0x7feecc06fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.561+0000 7feed0840640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc1539f0 0x7feecc14aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.561+0000 7feed0840640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feecc159650 con 0x7feecc1539f0 2024-09-17T04:36:01.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.561+0000 7feed0840640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7feecc0c6110 con 0x7feecc0c6e50 2024-09-17T04:36:01.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.561+0000 7feed0840640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7feecc0c7260 con 0x7feecc1535e0 2024-09-17T04:36:01.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.561+0000 7feecad9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc1539f0 0x7feecc14aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.561+0000 7feecad9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc1539f0 0x7feecc14aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37886/0 (socket says 172.21.15.43:37886) 2024-09-17T04:36:01.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.561+0000 7feecad9d640 1 -- 172.21.15.43:0/3033641604 learned_addr learned my addr 172.21.15.43:0/3033641604 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:36:01.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.561+0000 7feeca59c640 1 --2- 172.21.15.43:0/3033641604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feecc0c6e50 0x7feecc1efba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.561+0000 7feec9d9b640 1 --2- 172.21.15.43:0/3033641604 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feecc1535e0 0x7feecc06fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.562+0000 7feecad9d640 1 -- 172.21.15.43:0/3033641604 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feecc1535e0 msgr2=0x7feecc06fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.562+0000 7feecad9d640 1 --2- 172.21.15.43:0/3033641604 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feecc1535e0 0x7feecc06fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.562+0000 7feecad9d640 1 -- 172.21.15.43:0/3033641604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feecc0c6e50 msgr2=0x7feecc1efba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.562+0000 7feecad9d640 1 --2- 172.21.15.43:0/3033641604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feecc0c6e50 0x7feecc1efba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.562+0000 7feecad9d640 1 -- 172.21.15.43:0/3033641604 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc1f00e0 con 0x7feecc1539f0 2024-09-17T04:36:01.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.562+0000 7feeca59c640 1 --2- 172.21.15.43:0/3033641604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feecc0c6e50 0x7feecc1efba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:36:01.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.562+0000 7feecad9d640 1 --2- 172.21.15.43:0/3033641604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc1539f0 0x7feecc14aa30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feec4009cd0 tx=0x7feec4032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:01.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.562+0000 7feebaffd640 1 -- 172.21.15.43:0/3033641604 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec4037040 con 0x7feecc1539f0 2024-09-17T04:36:01.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.562+0000 7feebaffd640 1 -- 172.21.15.43:0/3033641604 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feec4042070 con 0x7feecc1539f0 2024-09-17T04:36:01.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.562+0000 7feed0840640 1 -- 172.21.15.43:0/3033641604 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feecc1f3160 con 0x7feecc1539f0 2024-09-17T04:36:01.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.562+0000 7feed0840640 1 -- 172.21.15.43:0/3033641604 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feecc1f3720 con 0x7feecc1539f0 2024-09-17T04:36:01.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.563+0000 7feebaffd640 1 -- 172.21.15.43:0/3033641604 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec4003e60 con 0x7feecc1539f0 2024-09-17T04:36:01.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.564+0000 7feed0840640 1 -- 172.21.15.43:0/3033641604 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feecc0b3ed0 con 0x7feecc1539f0 2024-09-17T04:36:01.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.565+0000 7feebaffd640 1 -- 172.21.15.43:0/3033641604 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feec4004280 con 0x7feecc1539f0 2024-09-17T04:36:01.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.566+0000 7feebaffd640 1 --2- 172.21.15.43:0/3033641604 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7feeac078b90 0x7feeac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:01.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.566+0000 7feebaffd640 1 -- 172.21.15.43:0/3033641604 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5833+0+0 (secure 0 0 0) 0x7feec40bb930 con 0x7feecc1539f0 2024-09-17T04:36:01.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.566+0000 7feeca59c640 1 --2- 172.21.15.43:0/3033641604 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7feeac078b90 0x7feeac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:01.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.567+0000 7feeca59c640 1 --2- 172.21.15.43:0/3033641604 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7feeac078b90 0x7feeac07b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feebc009f20 tx=0x7feebc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:01.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.575+0000 7feebaffd640 1 -- 172.21.15.43:0/3033641604 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feec40836b0 con 0x7feecc1539f0 2024-09-17T04:36:01.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.835+0000 7feed0840640 1 -- 172.21.15.43:0/3033641604 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7feecc0750b0 con 0x7feecc1539f0 2024-09-17T04:36:01.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.836+0000 7feebaffd640 1 -- 172.21.15.43:0/3033641604 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7feec40880e0 con 0x7feecc1539f0 2024-09-17T04:36:01.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.838+0000 7feed0840640 1 -- 172.21.15.43:0/3033641604 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7feeac078b90 msgr2=0x7feeac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.838+0000 7feed0840640 1 --2- 172.21.15.43:0/3033641604 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7feeac078b90 0x7feeac07b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feebc009f20 tx=0x7feebc005f90 comp rx=0 tx=0).stop 2024-09-17T04:36:01.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.838+0000 7feed0840640 1 -- 172.21.15.43:0/3033641604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc1539f0 msgr2=0x7feecc14aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:01.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.838+0000 7feed0840640 1 --2- 172.21.15.43:0/3033641604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc1539f0 0x7feecc14aa30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feec4009cd0 tx=0x7feec4032c60 comp rx=0 tx=0).stop 2024-09-17T04:36:01.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.839+0000 7feed0840640 1 -- 172.21.15.43:0/3033641604 shutdown_connections 2024-09-17T04:36:01.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.839+0000 7feed0840640 1 --2- 172.21.15.43:0/3033641604 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7feeac078b90 0x7feeac07b0a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.839+0000 7feed0840640 1 --2- 172.21.15.43:0/3033641604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc1539f0 0x7feecc14aa30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.839+0000 7feed0840640 1 --2- 172.21.15.43:0/3033641604 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feecc1535e0 0x7feecc06fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.839+0000 7feed0840640 1 --2- 172.21.15.43:0/3033641604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feecc0c6e50 0x7feecc1efba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:01.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.839+0000 7feed0840640 1 -- 172.21.15.43:0/3033641604 >> 172.21.15.43:0/3033641604 conn(0x7feecc0738e0 msgr2=0x7feecc14cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:01.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.839+0000 7feed0840640 1 -- 172.21.15.43:0/3033641604 shutdown_connections 2024-09-17T04:36:01.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:01.839+0000 7feed0840640 1 -- 172.21.15.43:0/3033641604 wait complete. 2024-09-17T04:36:01.851 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-17T04:36:11.853 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-17T04:36:11.853 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-17T04:36:12.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.028+0000 7f1a1069b640 1 -- 172.21.15.43:0/2489231845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a080c6f00 msgr2=0x7f1a080d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.028+0000 7f1a1069b640 1 --2- 172.21.15.43:0/2489231845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a080c6f00 0x7f1a080d15a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1a080c80b0 tx=0x7f1a0402a5b0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.028+0000 7f1a1069b640 1 -- 172.21.15.43:0/2489231845 shutdown_connections 2024-09-17T04:36:12.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.028+0000 7f1a1069b640 1 --2- 172.21.15.43:0/2489231845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a080c6f00 0x7f1a080d15a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.028+0000 7f1a1069b640 1 -- 172.21.15.43:0/2489231845 >> 172.21.15.43:0/2489231845 conn(0x7f1a0806f460 msgr2=0x7f1a0806f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:12.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.028+0000 7f1a1069b640 1 -- 172.21.15.43:0/2489231845 shutdown_connections 2024-09-17T04:36:12.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.028+0000 7f1a1069b640 1 -- 172.21.15.43:0/2489231845 wait complete. 2024-09-17T04:36:12.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.031+0000 7f1a1069b640 1 Processor -- start 2024-09-17T04:36:12.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.031+0000 7f1a1069b640 1 -- start start 2024-09-17T04:36:12.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.033+0000 7f1a1069b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a080c69b0 0x7f1a080c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.033+0000 7f1a1069b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a080c6f00 0x7f1a08157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.033+0000 7f1a1069b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a08155d40 0x7f1a080d0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.033+0000 7f1a1069b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1a080c7730 con 0x7f1a080c6f00 2024-09-17T04:36:12.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.033+0000 7f1a1069b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1a080c7aa0 con 0x7f1a08155d40 2024-09-17T04:36:12.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.033+0000 7f1a1069b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1a080b4d50 con 0x7f1a080c69b0 2024-09-17T04:36:12.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.033+0000 7f1a0dc36640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a080c6f00 0x7f1a08157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.033+0000 7f1a0dc36640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a080c6f00 0x7f1a08157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41336/0 (socket says 172.21.15.43:41336) 2024-09-17T04:36:12.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.033+0000 7f1a0dc36640 1 -- 172.21.15.43:0/2035177701 learned_addr learned my addr 172.21.15.43:0/2035177701 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:36:12.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.033+0000 7f1a0ec38640 1 --2- 172.21.15.43:0/2035177701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a08155d40 0x7f1a080d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.033+0000 7f1a0e437640 1 --2- 172.21.15.43:0/2035177701 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a080c69b0 0x7f1a080c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.034+0000 7f1a0e437640 1 -- 172.21.15.43:0/2035177701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a08155d40 msgr2=0x7f1a080d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.034+0000 7f1a0e437640 1 --2- 172.21.15.43:0/2035177701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a08155d40 0x7f1a080d0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.034+0000 7f1a0e437640 1 -- 172.21.15.43:0/2035177701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a080c6f00 msgr2=0x7f1a08157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.034+0000 7f1a0e437640 1 --2- 172.21.15.43:0/2035177701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a080c6f00 0x7f1a08157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.034+0000 7f1a0e437640 1 -- 172.21.15.43:0/2035177701 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a080c9140 con 0x7f1a080c69b0 2024-09-17T04:36:12.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.034+0000 7f1a0dc36640 1 --2- 172.21.15.43:0/2035177701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a080c6f00 0x7f1a08157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:36:12.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.034+0000 7f1a0e437640 1 --2- 172.21.15.43:0/2035177701 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a080c69b0 0x7f1a080c8c00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1a04031000 tx=0x7f1a04033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:12.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.034+0000 7f19feffd640 1 -- 172.21.15.43:0/2035177701 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a04005c90 con 0x7f1a080c69b0 2024-09-17T04:36:12.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.034+0000 7f19feffd640 1 -- 172.21.15.43:0/2035177701 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a04031e50 con 0x7f1a080c69b0 2024-09-17T04:36:12.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.034+0000 7f19feffd640 1 -- 172.21.15.43:0/2035177701 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a04005260 con 0x7f1a080c69b0 2024-09-17T04:36:12.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.035+0000 7f1a1069b640 1 -- 172.21.15.43:0/2035177701 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a081f5440 con 0x7f1a080c69b0 2024-09-17T04:36:12.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.035+0000 7f1a1069b640 1 -- 172.21.15.43:0/2035177701 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a080c9ff0 con 0x7f1a080c69b0 2024-09-17T04:36:12.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.036+0000 7f1a1069b640 1 -- 172.21.15.43:0/2035177701 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a080cc720 con 0x7f1a080c69b0 2024-09-17T04:36:12.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.037+0000 7f19feffd640 1 -- 172.21.15.43:0/2035177701 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1a04005400 con 0x7f1a080c69b0 2024-09-17T04:36:12.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.038+0000 7f19feffd640 1 --2- 172.21.15.43:0/2035177701 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f19ec078bc0 0x7f19ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.038+0000 7f19feffd640 1 -- 172.21.15.43:0/2035177701 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5833+0+0 (secure 0 0 0) 0x7f1a040bc0b0 con 0x7f1a080c69b0 2024-09-17T04:36:12.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.038+0000 7f1a0dc36640 1 --2- 172.21.15.43:0/2035177701 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f19ec078bc0 0x7f19ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.039+0000 7f1a0dc36640 1 --2- 172.21.15.43:0/2035177701 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f19ec078bc0 0x7f19ec07b0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1a080d0bb0 tx=0x7f19f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:12.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.043+0000 7f19feffd640 1 -- 172.21.15.43:0/2035177701 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1a0403f030 con 0x7f1a080c69b0 2024-09-17T04:36:12.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.338+0000 7f1a1069b640 1 -- 172.21.15.43:0/2035177701 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1a080b3d30 con 0x7f1a080c69b0 2024-09-17T04:36:12.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.339+0000 7f19feffd640 1 -- 172.21.15.43:0/2035177701 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f1a040056f0 con 0x7f1a080c69b0 2024-09-17T04:36:12.339 INFO:teuthology.orchestra.run.smithi043.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","modified":"2024-09-17T04:33:51.199044Z","created":"2024-09-17T04:33:51.199044Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3301","nonce":0},{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-17T04:36:12.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.342+0000 7f1a1069b640 1 -- 172.21.15.43:0/2035177701 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f19ec078bc0 msgr2=0x7f19ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.342+0000 7f1a1069b640 1 --2- 172.21.15.43:0/2035177701 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f19ec078bc0 0x7f19ec07b0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1a080d0bb0 tx=0x7f19f8009040 comp rx=0 tx=0).stop 2024-09-17T04:36:12.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.342+0000 7f1a1069b640 1 -- 172.21.15.43:0/2035177701 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a080c69b0 msgr2=0x7f1a080c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.342+0000 7f1a1069b640 1 --2- 172.21.15.43:0/2035177701 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a080c69b0 0x7f1a080c8c00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1a04031000 tx=0x7f1a04033c20 comp rx=0 tx=0).stop 2024-09-17T04:36:12.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.342+0000 7f1a1069b640 1 -- 172.21.15.43:0/2035177701 shutdown_connections 2024-09-17T04:36:12.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.342+0000 7f1a1069b640 1 --2- 172.21.15.43:0/2035177701 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f19ec078bc0 0x7f19ec07b0d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.342+0000 7f1a1069b640 1 --2- 172.21.15.43:0/2035177701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a08155d40 0x7f1a080d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.342+0000 7f1a1069b640 1 --2- 172.21.15.43:0/2035177701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a080c6f00 0x7f1a08157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.342+0000 7f1a1069b640 1 --2- 172.21.15.43:0/2035177701 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a080c69b0 0x7f1a080c8c00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.342+0000 7f1a1069b640 1 -- 172.21.15.43:0/2035177701 >> 172.21.15.43:0/2035177701 conn(0x7f1a0806f460 msgr2=0x7f1a0815edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:12.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.342+0000 7f1a1069b640 1 -- 172.21.15.43:0/2035177701 shutdown_connections 2024-09-17T04:36:12.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.342+0000 7f1a1069b640 1 -- 172.21.15.43:0/2035177701 wait complete. 2024-09-17T04:36:12.357 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-17T04:36:12.357 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-17T04:36:12.357 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-17T04:36:12.358 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-17T04:36:12.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.476+0000 7f5d867fc640 1 -- 172.21.15.43:0/2571883485 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8002fe30 con 0x7f5d880c69b0 2024-09-17T04:36:12.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.477+0000 7f5d8e038640 1 -- 172.21.15.43:0/2571883485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d880c69b0 msgr2=0x7f5d880d1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.477+0000 7f5d8e038640 1 --2- 172.21.15.43:0/2571883485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d880c69b0 0x7f5d880d1ae0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5d8808e2c0 tx=0x7f5d8002aa30 comp rx=0 tx=0).stop 2024-09-17T04:36:12.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.477+0000 7f5d8e038640 1 -- 172.21.15.43:0/2571883485 shutdown_connections 2024-09-17T04:36:12.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.477+0000 7f5d8e038640 1 --2- 172.21.15.43:0/2571883485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d880c69b0 0x7f5d880d1ae0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.477+0000 7f5d8e038640 1 --2- 172.21.15.43:0/2571883485 >> v2:172.21.15.62:3300/0 conn(0x7f5d880c6f00 0x7f5d880d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.477+0000 7f5d8e038640 1 -- 172.21.15.43:0/2571883485 >> 172.21.15.43:0/2571883485 conn(0x7f5d8806f460 msgr2=0x7f5d8806f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:12.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.477+0000 7f5d8e038640 1 -- 172.21.15.43:0/2571883485 shutdown_connections 2024-09-17T04:36:12.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.477+0000 7f5d8e038640 1 -- 172.21.15.43:0/2571883485 wait complete. 2024-09-17T04:36:12.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.480+0000 7f5d8e038640 1 Processor -- start 2024-09-17T04:36:12.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.480+0000 7f5d8e038640 1 -- start start 2024-09-17T04:36:12.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.483+0000 7f5d8e038640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d880c69b0 0x7f5d880ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.483+0000 7f5d8e038640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d880c6f00 0x7f5d88154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.483+0000 7f5d8e038640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d88155d40 0x7f5d88154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.483+0000 7f5d8e038640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5d880c7730 con 0x7f5d880c6f00 2024-09-17T04:36:12.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.483+0000 7f5d8e038640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5d880c7450 con 0x7f5d88155d40 2024-09-17T04:36:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.483+0000 7f5d8e038640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5d880b4d50 con 0x7f5d880c69b0 2024-09-17T04:36:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.483+0000 7f5d86ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d880c6f00 0x7f5d88154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.483+0000 7f5d86ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d880c6f00 0x7f5d88154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41360/0 (socket says 172.21.15.43:41360) 2024-09-17T04:36:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.483+0000 7f5d86ffd640 1 -- 172.21.15.43:0/4289448421 learned_addr learned my addr 172.21.15.43:0/4289448421 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:36:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.483+0000 7f5d877fe640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d880c69b0 0x7f5d880ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.483+0000 7f5d87fff640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d88155d40 0x7f5d88154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.483+0000 7f5d86ffd640 1 -- 172.21.15.43:0/4289448421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d880c69b0 msgr2=0x7f5d880ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.483+0000 7f5d86ffd640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d880c69b0 0x7f5d880ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.483+0000 7f5d86ffd640 1 -- 172.21.15.43:0/4289448421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d88155d40 msgr2=0x7f5d88154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.483+0000 7f5d86ffd640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d88155d40 0x7f5d88154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.483+0000 7f5d86ffd640 1 -- 172.21.15.43:0/4289448421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d880cae90 con 0x7f5d880c6f00 2024-09-17T04:36:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.484+0000 7f5d86ffd640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d880c6f00 0x7f5d88154640 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00b420 tx=0x7f5d7c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:12.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.484+0000 7f5d6ffff640 1 -- 172.21.15.43:0/4289448421 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c011830 con 0x7f5d880c6f00 2024-09-17T04:36:12.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.484+0000 7f5d8e038640 1 -- 172.21.15.43:0/4289448421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d8815e390 con 0x7f5d880c6f00 2024-09-17T04:36:12.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.484+0000 7f5d6ffff640 1 -- 172.21.15.43:0/4289448421 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d7c016070 con 0x7f5d880c6f00 2024-09-17T04:36:12.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.484+0000 7f5d6ffff640 1 -- 172.21.15.43:0/4289448421 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c011d60 con 0x7f5d880c6f00 2024-09-17T04:36:12.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.485+0000 7f5d8e038640 1 -- 172.21.15.43:0/4289448421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d881f1bd0 con 0x7f5d880c6f00 2024-09-17T04:36:12.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.485+0000 7f5d8e038640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d881f26b0 0x7f5d881f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.485+0000 7f5d8e038640 1 -- 172.21.15.43:0/4289448421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8814de10 con 0x7f5d881f26b0 2024-09-17T04:36:12.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.486+0000 7f5d877fe640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d881f26b0 0x7f5d881f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.486+0000 7f5d877fe640 1 -- 172.21.15.43:0/4289448421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d8815ef60 con 0x7f5d881f26b0 2024-09-17T04:36:12.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.486+0000 7f5d877fe640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d881f26b0 0x7f5d881f1e10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800e990 tx=0x7f5d7800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:12.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.487+0000 7f5d6ffff640 1 -- 172.21.15.43:0/4289448421 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7800ad50 con 0x7f5d881f26b0 2024-09-17T04:36:12.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.487+0000 7f5d6ffff640 1 -- 172.21.15.43:0/4289448421 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5d7c01b460 con 0x7f5d880c6f00 2024-09-17T04:36:12.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.487+0000 7f5d6ffff640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5d74078ac0 0x7f5d7407afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.488+0000 7f5d6ffff640 1 -- 172.21.15.43:0/4289448421 <== mon.0 v2:172.21.15.43:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5d78004030 con 0x7f5d881f26b0 2024-09-17T04:36:12.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.488+0000 7f5d6ffff640 1 -- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d881f26b0 msgr2=0x7f5d881f1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.488+0000 7f5d6ffff640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d881f26b0 0x7f5d881f1e10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800e990 tx=0x7f5d7800ee50 comp rx=0 tx=0).stop 2024-09-17T04:36:12.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.488+0000 7f5d6ffff640 1 -- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d881f26b0 msgr2=0x7f5d881f1e10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:36:12.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.488+0000 7f5d6ffff640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d881f26b0 0x7f5d881f1e10 secure :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800e990 tx=0x7f5d7800ee50 comp rx=0 tx=0).stop 2024-09-17T04:36:12.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.488+0000 7f5d6ffff640 1 -- 172.21.15.43:0/4289448421 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5833+0+0 (secure 0 0 0) 0x7f5d7c09a1c0 con 0x7f5d880c6f00 2024-09-17T04:36:12.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.488+0000 7f5d87fff640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5d74078ac0 0x7f5d7407afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.489+0000 7f5d87fff640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5d74078ac0 0x7f5d7407afd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5d80035000 tx=0x7f5d80004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:12.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.494+0000 7f5d8e038640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d881f5020 0x7f5d881f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.494+0000 7f5d8e038640 1 -- 172.21.15.43:0/4289448421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5d881f2350 con 0x7f5d881f5020 2024-09-17T04:36:12.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.494+0000 7f5d877fe640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d881f5020 0x7f5d881f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.495+0000 7f5d877fe640 1 -- 172.21.15.43:0/4289448421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5d880cc640 con 0x7f5d881f5020 2024-09-17T04:36:12.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.495+0000 7f5d877fe640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d881f5020 0x7f5d881f5430 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5d78019000 tx=0x7f5d780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:12.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.495+0000 7f5d6ffff640 1 -- 172.21.15.43:0/4289448421 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d78003d00 con 0x7f5d881f5020 2024-09-17T04:36:12.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.495+0000 7f5d6ffff640 1 -- 172.21.15.43:0/4289448421 <== mon.0 v2:172.21.15.43:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5045 (secure 0 0 0) 0x7f5d78003d00 con 0x7f5d881f5020 2024-09-17T04:36:12.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.495+0000 7f5d6ffff640 1 -- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d881f5020 msgr2=0x7f5d881f5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.495+0000 7f5d6ffff640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d881f5020 0x7f5d881f5430 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5d78019000 tx=0x7f5d780046c0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.495+0000 7f5d6ffff640 1 -- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d881f5020 msgr2=0x7f5d881f5430 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:36:12.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.495+0000 7f5d6ffff640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d881f5020 0x7f5d881f5430 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.496 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-17T04:36:12.496 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "a", 2024-09-17T04:36:12.496 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 0, 2024-09-17T04:36:12.496 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "leader", 2024-09-17T04:36:12.496 INFO:teuthology.orchestra.run.smithi043.stdout: "election_epoch": 10, 2024-09-17T04:36:12.497 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 106236, 2024-09-17T04:36:12.497 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum": [ 2024-09-17T04:36:12.497 INFO:teuthology.orchestra.run.smithi043.stdout: 0, 2024-09-17T04:36:12.497 INFO:teuthology.orchestra.run.smithi043.stdout: 1, 2024-09-17T04:36:12.497 INFO:teuthology.orchestra.run.smithi043.stdout: 2 2024-09-17T04:36:12.497 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.497 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_age": 11, 2024-09-17T04:36:12.497 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:36:12.497 INFO:teuthology.orchestra.run.smithi043.stdout: "required_con": "2450521708007866372", 2024-09-17T04:36:12.497 INFO:teuthology.orchestra.run.smithi043.stdout: "required_mon": [ 2024-09-17T04:36:12.497 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:12.497 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:12.497 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:12.497 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_con": "4540719139924082687", 2024-09-17T04:36:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_mon": [ 2024-09-17T04:36:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "outside_quorum": [], 2024-09-17T04:36:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "extra_probe_peers": [], 2024-09-17T04:36:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "sync_provider": [], 2024-09-17T04:36:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "monmap": { 2024-09-17T04:36:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 1, 2024-09-17T04:36:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "cdef1e3e-07e6-43e6-b635-3ed1bc15d64a", 2024-09-17T04:36:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:36:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:36:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release": 19, 2024-09-17T04:36:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release_name": "squid", 2024-09-17T04:36:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "election_strategy": 1, 2024-09-17T04:36:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "disallowed_leaders: ": "", 2024-09-17T04:36:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false, 2024-09-17T04:36:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "tiebreaker_mon": "", 2024-09-17T04:36:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_ranks: ": "", 2024-09-17T04:36:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:36:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "persistent": [ 2024-09-17T04:36:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "optional": [] 2024-09-17T04:36:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "mons": [ 2024-09-17T04:36:12.502 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.502 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 0, 2024-09-17T04:36:12.502 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "a", 2024-09-17T04:36:12.502 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:12.502 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:12.502 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.502 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:12.502 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:3300", 2024-09-17T04:36:12.502 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.502 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.502 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.502 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:12.502 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789", 2024-09-17T04:36:12.502 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.503 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.503 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.503 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.503 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789/0", 2024-09-17T04:36:12.503 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.43:6789/0", 2024-09-17T04:36:12.503 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:12.503 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:12.503 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:12.503 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.503 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.503 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 1, 2024-09-17T04:36:12.503 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "b", 2024-09-17T04:36:12.504 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:12.504 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:12.504 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.504 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:12.504 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3300", 2024-09-17T04:36:12.504 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.504 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.504 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.504 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:12.504 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789", 2024-09-17T04:36:12.504 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.504 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.505 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.505 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.505 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789/0", 2024-09-17T04:36:12.505 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6789/0", 2024-09-17T04:36:12.505 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:12.505 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:12.505 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:12.505 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.505 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.505 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 2, 2024-09-17T04:36:12.505 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "c", 2024-09-17T04:36:12.505 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:12.505 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:12.506 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.506 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:12.506 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3301", 2024-09-17T04:36:12.506 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.506 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.506 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.506 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:12.506 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790", 2024-09-17T04:36:12.506 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.506 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.506 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.506 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.506 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790/0", 2024-09-17T04:36:12.507 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6790/0", 2024-09-17T04:36:12.507 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:12.507 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:12.507 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:12.507 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.507 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.507 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.507 INFO:teuthology.orchestra.run.smithi043.stdout: "feature_map": { 2024-09-17T04:36:12.507 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": [ 2024-09-17T04:36:12.507 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.507 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:12.507 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:12.507 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:36:12.507 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.508 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.508 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": [ 2024-09-17T04:36:12.508 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.508 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:12.508 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:12.508 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 5 2024-09-17T04:36:12.508 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.508 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.508 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": [ 2024-09-17T04:36:12.508 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.508 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:12.508 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:12.508 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 6 2024-09-17T04:36:12.508 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.508 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.509 INFO:teuthology.orchestra.run.smithi043.stdout: "client": [ 2024-09-17T04:36:12.509 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.509 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:12.509 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:12.509 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 2 2024-09-17T04:36:12.509 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.509 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.509 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": [ 2024-09-17T04:36:12.509 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.509 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:12.509 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:12.509 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:36:12.509 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.510 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.510 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.510 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false 2024-09-17T04:36:12.510 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-17T04:36:12.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.496+0000 7f5d8e038640 1 -- 172.21.15.43:0/4289448421 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5d74078ac0 msgr2=0x7f5d7407afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.496+0000 7f5d8e038640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f5d74078ac0 0x7f5d7407afd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5d80035000 tx=0x7f5d80004ab0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.496+0000 7f5d8e038640 1 -- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d880c6f00 msgr2=0x7f5d88154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.496+0000 7f5d8e038640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d880c6f00 0x7f5d88154640 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00b420 tx=0x7f5d7c00b8e0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.496+0000 7f5d87fff640 1 -- 172.21.15.43:0/4289448421 reap_dead start 2024-09-17T04:36:12.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.496+0000 7f5d8e038640 1 -- 172.21.15.43:0/4289448421 shutdown_connections 2024-09-17T04:36:12.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.496+0000 7f5d8e038640 1 --2- 172.21.15.43:0/4289448421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d880c6f00 0x7f5d88154640 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.496+0000 7f5d8e038640 1 -- 172.21.15.43:0/4289448421 >> 172.21.15.43:0/4289448421 conn(0x7f5d8806f460 msgr2=0x7f5d88151a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:12.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.496+0000 7f5d8e038640 1 -- 172.21.15.43:0/4289448421 shutdown_connections 2024-09-17T04:36:12.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.496+0000 7f5d8e038640 1 -- 172.21.15.43:0/4289448421 wait complete. 2024-09-17T04:36:12.512 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-17T04:36:12.512 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-17T04:36:12.512 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-17T04:36:12.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.633+0000 7fe9c3af9640 1 -- 172.21.15.43:0/4029230918 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9bc0c6f00 msgr2=0x7fe9bc0d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.633+0000 7fe9c3af9640 1 --2- 172.21.15.43:0/4029230918 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9bc0c6f00 0x7fe9bc0d15a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009830 tx=0x7fe9b802a510 comp rx=0 tx=0).stop 2024-09-17T04:36:12.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.633+0000 7fe9c3af9640 1 -- 172.21.15.43:0/4029230918 shutdown_connections 2024-09-17T04:36:12.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.633+0000 7fe9c3af9640 1 --2- 172.21.15.43:0/4029230918 >> v2:172.21.15.62:3300/0 conn(0x7fe9bc0c69b0 0x7fe9bc0d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.633+0000 7fe9c3af9640 1 --2- 172.21.15.43:0/4029230918 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9bc0c6f00 0x7fe9bc0d15a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.633+0000 7fe9c3af9640 1 -- 172.21.15.43:0/4029230918 >> 172.21.15.43:0/4029230918 conn(0x7fe9bc06f460 msgr2=0x7fe9bc06f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:12.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.633+0000 7fe9c3af9640 1 -- 172.21.15.43:0/4029230918 shutdown_connections 2024-09-17T04:36:12.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.633+0000 7fe9c3af9640 1 -- 172.21.15.43:0/4029230918 wait complete. 2024-09-17T04:36:12.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.636+0000 7fe9c3af9640 1 Processor -- start 2024-09-17T04:36:12.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.636+0000 7fe9c3af9640 1 -- start start 2024-09-17T04:36:12.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.638+0000 7fe9c3af9640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9bc0c69b0 0x7fe9bc150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.638+0000 7fe9c3af9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9bc0c6f00 0x7fe9bc0d0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.638+0000 7fe9c3af9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc155d40 0x7fe9bc14d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.638+0000 7fe9c3af9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc0c7730 con 0x7fe9bc0c6f00 2024-09-17T04:36:12.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.638+0000 7fe9c3af9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc0c7450 con 0x7fe9bc155d40 2024-09-17T04:36:12.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.638+0000 7fe9c3af9640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe9bc0b4d50 con 0x7fe9bc0c69b0 2024-09-17T04:36:12.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.638+0000 7fe9c1094640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9bc0c6f00 0x7fe9bc0d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.638+0000 7fe9c1094640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9bc0c6f00 0x7fe9bc0d0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41392/0 (socket says 172.21.15.43:41392) 2024-09-17T04:36:12.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.638+0000 7fe9c1094640 1 -- 172.21.15.43:0/3038914837 learned_addr learned my addr 172.21.15.43:0/3038914837 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:36:12.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.638+0000 7fe9c1895640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9bc0c69b0 0x7fe9bc150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.638+0000 7fe9c2096640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc155d40 0x7fe9bc14d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.639+0000 7fe9c1895640 1 -- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc155d40 msgr2=0x7fe9bc14d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.639+0000 7fe9c1895640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc155d40 0x7fe9bc14d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.639+0000 7fe9c1895640 1 -- 172.21.15.43:0/3038914837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9bc0c6f00 msgr2=0x7fe9bc0d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.639+0000 7fe9c1895640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9bc0c6f00 0x7fe9bc0d0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.639+0000 7fe9c1895640 1 -- 172.21.15.43:0/3038914837 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9bc150b50 con 0x7fe9bc0c69b0 2024-09-17T04:36:12.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.639+0000 7fe9c1094640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9bc0c6f00 0x7fe9bc0d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:36:12.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.639+0000 7fe9c1895640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9bc0c69b0 0x7fe9bc150610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8031000 tx=0x7fe9b8033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:12.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.639+0000 7fe9b27fc640 1 -- 172.21.15.43:0/3038914837 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8005c90 con 0x7fe9bc0c69b0 2024-09-17T04:36:12.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.639+0000 7fe9b27fc640 1 -- 172.21.15.43:0/3038914837 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9b8031e50 con 0x7fe9bc0c69b0 2024-09-17T04:36:12.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.639+0000 7fe9c3af9640 1 -- 172.21.15.43:0/3038914837 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9bc0c8550 con 0x7fe9bc0c69b0 2024-09-17T04:36:12.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.641+0000 7fe9b27fc640 1 -- 172.21.15.43:0/3038914837 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8005280 con 0x7fe9bc0c69b0 2024-09-17T04:36:12.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.641+0000 7fe9c3af9640 1 -- 172.21.15.43:0/3038914837 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9bc1500f0 con 0x7fe9bc0c69b0 2024-09-17T04:36:12.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.642+0000 7fe9c3af9640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc150d20 0x7fe9bc14d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.642+0000 7fe9c3af9640 1 -- 172.21.15.43:0/3038914837 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc14edf0 con 0x7fe9bc150d20 2024-09-17T04:36:12.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.642+0000 7fe9b27fc640 1 -- 172.21.15.43:0/3038914837 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe9b80054a0 con 0x7fe9bc0c69b0 2024-09-17T04:36:12.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.643+0000 7fe9b27fc640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe9a0078b60 0x7fe9a007b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.643+0000 7fe9c1094640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc150d20 0x7fe9bc14d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.643+0000 7fe9b27fc640 1 -- 172.21.15.43:0/3038914837 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5833+0+0 (secure 0 0 0) 0x7fe9b80bb180 con 0x7fe9bc0c69b0 2024-09-17T04:36:12.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.643+0000 7fe9c2096640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe9a0078b60 0x7fe9a007b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.644+0000 7fe9c1094640 1 -- 172.21.15.43:0/3038914837 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9bc0c8300 con 0x7fe9bc150d20 2024-09-17T04:36:12.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.644+0000 7fe9c2096640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe9a0078b60 0x7fe9a007b070 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc06edf0 tx=0x7fe9b4009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:12.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.644+0000 7fe9c1094640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc150d20 0x7fe9bc14d700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac007fd0 tx=0x7fe9ac00ff50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:12.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.644+0000 7fe9b27fc640 1 -- 172.21.15.43:0/3038914837 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac018030 con 0x7fe9bc150d20 2024-09-17T04:36:12.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.644+0000 7fe9b27fc640 1 -- 172.21.15.43:0/3038914837 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe9ac00d9f0 con 0x7fe9bc150d20 2024-09-17T04:36:12.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.644+0000 7fe9b27fc640 1 -- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc150d20 msgr2=0x7fe9bc14d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.644+0000 7fe9b27fc640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc150d20 0x7fe9bc14d700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac007fd0 tx=0x7fe9ac00ff50 comp rx=0 tx=0).stop 2024-09-17T04:36:12.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.644+0000 7fe9b27fc640 1 -- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc150d20 msgr2=0x7fe9bc14d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:36:12.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.644+0000 7fe9b27fc640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc150d20 0x7fe9bc14d700 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac007fd0 tx=0x7fe9ac00ff50 comp rx=0 tx=0).stop 2024-09-17T04:36:12.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.651+0000 7fe9c3af9640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc151d00 0x7fe9bc14a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.651+0000 7fe9c3af9640 1 -- 172.21.15.43:0/3038914837 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc0cc640 con 0x7fe9bc151d00 2024-09-17T04:36:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.651+0000 7fe9c1094640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc151d00 0x7fe9bc14a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.651+0000 7fe9c1094640 1 -- 172.21.15.43:0/3038914837 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe9bc0b3d30 con 0x7fe9bc151d00 2024-09-17T04:36:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.652+0000 7fe9c1094640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc151d00 0x7fe9bc14a980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac007fd0 tx=0x7fe9ac004620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.652+0000 7fe9b27fc640 1 -- 172.21.15.43:0/3038914837 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac01ec60 con 0x7fe9bc151d00 2024-09-17T04:36:12.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.652+0000 7fe9b27fc640 1 -- 172.21.15.43:0/3038914837 <== mon.1 v2:172.21.15.62:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5186 (secure 0 0 0) 0x7fe9ac0046c0 con 0x7fe9bc151d00 2024-09-17T04:36:12.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.652+0000 7fe9b27fc640 1 -- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc151d00 msgr2=0x7fe9bc14a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.652+0000 7fe9b27fc640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc151d00 0x7fe9bc14a980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac007fd0 tx=0x7fe9ac004620 comp rx=0 tx=0).stop 2024-09-17T04:36:12.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.652+0000 7fe9b27fc640 1 -- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc151d00 msgr2=0x7fe9bc14a980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:36:12.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.652+0000 7fe9b27fc640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9bc151d00 0x7fe9bc14a980 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac007fd0 tx=0x7fe9ac004620 comp rx=0 tx=0).stop 2024-09-17T04:36:12.653 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-17T04:36:12.653 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "b", 2024-09-17T04:36:12.653 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 1, 2024-09-17T04:36:12.653 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "peon", 2024-09-17T04:36:12.653 INFO:teuthology.orchestra.run.smithi043.stdout: "election_epoch": 10, 2024-09-17T04:36:12.653 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 106356, 2024-09-17T04:36:12.653 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum": [ 2024-09-17T04:36:12.653 INFO:teuthology.orchestra.run.smithi043.stdout: 0, 2024-09-17T04:36:12.653 INFO:teuthology.orchestra.run.smithi043.stdout: 1, 2024-09-17T04:36:12.653 INFO:teuthology.orchestra.run.smithi043.stdout: 2 2024-09-17T04:36:12.654 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.654 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_age": 11, 2024-09-17T04:36:12.654 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:36:12.654 INFO:teuthology.orchestra.run.smithi043.stdout: "required_con": "2450521708007866372", 2024-09-17T04:36:12.654 INFO:teuthology.orchestra.run.smithi043.stdout: "required_mon": [ 2024-09-17T04:36:12.654 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:12.654 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:12.654 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:12.654 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:12.654 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:12.654 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:12.654 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:12.654 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:12.654 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:12.655 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:12.655 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:12.655 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.655 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_con": "4540719139924082687", 2024-09-17T04:36:12.655 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_mon": [ 2024-09-17T04:36:12.655 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:12.655 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:12.655 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:12.655 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:12.655 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:12.655 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:12.655 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:12.655 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:12.655 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:12.656 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:12.656 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:12.656 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.656 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.656 INFO:teuthology.orchestra.run.smithi043.stdout: "outside_quorum": [], 2024-09-17T04:36:12.656 INFO:teuthology.orchestra.run.smithi043.stdout: "extra_probe_peers": [], 2024-09-17T04:36:12.656 INFO:teuthology.orchestra.run.smithi043.stdout: "sync_provider": [], 2024-09-17T04:36:12.656 INFO:teuthology.orchestra.run.smithi043.stdout: "monmap": { 2024-09-17T04:36:12.656 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 1, 2024-09-17T04:36:12.656 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "cdef1e3e-07e6-43e6-b635-3ed1bc15d64a", 2024-09-17T04:36:12.656 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:36:12.656 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:36:12.656 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release": 19, 2024-09-17T04:36:12.657 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release_name": "squid", 2024-09-17T04:36:12.657 INFO:teuthology.orchestra.run.smithi043.stdout: "election_strategy": 1, 2024-09-17T04:36:12.657 INFO:teuthology.orchestra.run.smithi043.stdout: "disallowed_leaders: ": "", 2024-09-17T04:36:12.657 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false, 2024-09-17T04:36:12.657 INFO:teuthology.orchestra.run.smithi043.stdout: "tiebreaker_mon": "", 2024-09-17T04:36:12.657 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_ranks: ": "", 2024-09-17T04:36:12.657 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:36:12.657 INFO:teuthology.orchestra.run.smithi043.stdout: "persistent": [ 2024-09-17T04:36:12.657 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:12.657 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:12.657 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:12.657 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:12.657 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:12.658 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:12.658 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:12.658 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:12.658 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:12.658 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:12.658 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:12.658 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.658 INFO:teuthology.orchestra.run.smithi043.stdout: "optional": [] 2024-09-17T04:36:12.658 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.658 INFO:teuthology.orchestra.run.smithi043.stdout: "mons": [ 2024-09-17T04:36:12.658 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.658 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 0, 2024-09-17T04:36:12.658 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "a", 2024-09-17T04:36:12.658 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:12.659 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:12.659 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.659 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:12.659 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:3300", 2024-09-17T04:36:12.659 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.659 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.659 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.659 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:12.659 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789", 2024-09-17T04:36:12.659 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.659 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.659 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.659 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.659 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789/0", 2024-09-17T04:36:12.660 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.43:6789/0", 2024-09-17T04:36:12.660 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:12.660 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:12.660 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:12.660 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.660 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.660 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 1, 2024-09-17T04:36:12.660 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "b", 2024-09-17T04:36:12.660 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:12.660 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:12.660 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.660 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:12.660 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3300", 2024-09-17T04:36:12.661 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.661 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.661 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.661 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:12.661 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789", 2024-09-17T04:36:12.661 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.661 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.661 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.661 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.661 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789/0", 2024-09-17T04:36:12.661 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6789/0", 2024-09-17T04:36:12.661 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:12.661 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:12.662 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:12.662 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.662 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.662 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 2, 2024-09-17T04:36:12.662 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "c", 2024-09-17T04:36:12.662 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:12.662 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:12.662 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.662 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:12.662 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3301", 2024-09-17T04:36:12.662 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.662 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.662 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.662 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:12.662 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790", 2024-09-17T04:36:12.663 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.663 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.663 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.663 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.663 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790/0", 2024-09-17T04:36:12.663 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6790/0", 2024-09-17T04:36:12.663 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:12.663 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:12.663 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:12.663 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.663 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.663 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.663 INFO:teuthology.orchestra.run.smithi043.stdout: "feature_map": { 2024-09-17T04:36:12.663 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": [ 2024-09-17T04:36:12.664 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.664 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:12.664 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:12.664 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:36:12.664 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.664 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.664 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": [ 2024-09-17T04:36:12.664 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.664 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:12.664 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:12.664 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:36:12.664 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.664 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.665 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": [ 2024-09-17T04:36:12.665 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.665 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:12.665 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:12.665 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 2 2024-09-17T04:36:12.665 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.665 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.665 INFO:teuthology.orchestra.run.smithi043.stdout: "client": [ 2024-09-17T04:36:12.665 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.665 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x2f018fb87aa4aafe", 2024-09-17T04:36:12.665 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "luminous", 2024-09-17T04:36:12.665 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:36:12.665 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.665 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.666 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:12.666 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:12.666 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 5 2024-09-17T04:36:12.666 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.666 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.666 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": [ 2024-09-17T04:36:12.666 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.666 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:12.666 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:12.666 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:36:12.666 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.666 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.666 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.666 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false 2024-09-17T04:36:12.667 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-17T04:36:12.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.653+0000 7fe9c3af9640 1 -- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe9a0078b60 msgr2=0x7fe9a007b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.653+0000 7fe9c3af9640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fe9a0078b60 0x7fe9a007b070 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc06edf0 tx=0x7fe9b4009500 comp rx=0 tx=0).stop 2024-09-17T04:36:12.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.653+0000 7fe9c3af9640 1 -- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9bc0c69b0 msgr2=0x7fe9bc150610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.653+0000 7fe9c3af9640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9bc0c69b0 0x7fe9bc150610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8031000 tx=0x7fe9b8033c20 comp rx=0 tx=0).stop 2024-09-17T04:36:12.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.653+0000 7fe9c2096640 1 -- 172.21.15.43:0/3038914837 reap_dead start 2024-09-17T04:36:12.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.653+0000 7fe9c3af9640 1 -- 172.21.15.43:0/3038914837 shutdown_connections 2024-09-17T04:36:12.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.653+0000 7fe9c3af9640 1 --2- 172.21.15.43:0/3038914837 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9bc0c69b0 0x7fe9bc150610 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.653+0000 7fe9c3af9640 1 -- 172.21.15.43:0/3038914837 >> 172.21.15.43:0/3038914837 conn(0x7fe9bc06f460 msgr2=0x7fe9bc15a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:12.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.653+0000 7fe9c3af9640 1 -- 172.21.15.43:0/3038914837 shutdown_connections 2024-09-17T04:36:12.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.653+0000 7fe9c3af9640 1 -- 172.21.15.43:0/3038914837 wait complete. 2024-09-17T04:36:12.669 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-17T04:36:12.669 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-17T04:36:12.669 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-17T04:36:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.790+0000 7fc7d8bdf640 1 -- 172.21.15.43:0/2365293524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7d4073240 msgr2=0x7fc7d4073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.790+0000 7fc7d8bdf640 1 --2- 172.21.15.43:0/2365293524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7d4073240 0x7fc7d4073650 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc005fd0 tx=0x7fc7cc02ab20 comp rx=0 tx=0).stop 2024-09-17T04:36:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.791+0000 7fc7d8bdf640 1 -- 172.21.15.43:0/2365293524 shutdown_connections 2024-09-17T04:36:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.791+0000 7fc7d8bdf640 1 --2- 172.21.15.43:0/2365293524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7d4073240 0x7fc7d4073650 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.791+0000 7fc7d8bdf640 1 --2- 172.21.15.43:0/2365293524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d4159250 0x7fc7d4152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.791+0000 7fc7d8bdf640 1 -- 172.21.15.43:0/2365293524 >> 172.21.15.43:0/2365293524 conn(0x7fc7d406cdb0 msgr2=0x7fc7d406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.791+0000 7fc7d8bdf640 1 -- 172.21.15.43:0/2365293524 shutdown_connections 2024-09-17T04:36:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.791+0000 7fc7d8bdf640 1 -- 172.21.15.43:0/2365293524 wait complete. 2024-09-17T04:36:12.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.793+0000 7fc7d8bdf640 1 Processor -- start 2024-09-17T04:36:12.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.793+0000 7fc7d8bdf640 1 -- start start 2024-09-17T04:36:12.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.794+0000 7fc7d8bdf640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d4073240 0x7fc7d41472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.794+0000 7fc7d8bdf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7d4074540 0x7fc7d41efa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.794+0000 7fc7d8bdf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d4159250 0x7fc7d414e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.794+0000 7fc7d8bdf640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d4069290 con 0x7fc7d4074540 2024-09-17T04:36:12.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.794+0000 7fc7d8bdf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d4073b90 con 0x7fc7d4159250 2024-09-17T04:36:12.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.794+0000 7fc7d8bdf640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d4152e40 con 0x7fc7d4073240 2024-09-17T04:36:12.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.794+0000 7fc7d1d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7d4074540 0x7fc7d41efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.794+0000 7fc7d1d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7d4074540 0x7fc7d41efa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41406/0 (socket says 172.21.15.43:41406) 2024-09-17T04:36:12.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.794+0000 7fc7d1d9b640 1 -- 172.21.15.43:0/3767145086 learned_addr learned my addr 172.21.15.43:0/3767145086 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:36:12.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.795+0000 7fc7d259c640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d4073240 0x7fc7d41472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.795+0000 7fc7d2d9d640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d4159250 0x7fc7d414e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.795+0000 7fc7d1d9b640 1 -- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d4073240 msgr2=0x7fc7d41472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.795+0000 7fc7d1d9b640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d4073240 0x7fc7d41472c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.795+0000 7fc7d1d9b640 1 -- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d4159250 msgr2=0x7fc7d414e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.795+0000 7fc7d1d9b640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d4159250 0x7fc7d414e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.795+0000 7fc7d1d9b640 1 -- 172.21.15.43:0/3767145086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d41effd0 con 0x7fc7d4074540 2024-09-17T04:36:12.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.795+0000 7fc7d1d9b640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7d4074540 0x7fc7d41efa90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800c3d0 tx=0x7fc7c800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:12.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.795+0000 7fc7c2ffd640 1 -- 172.21.15.43:0/3767145086 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8017070 con 0x7fc7d4074540 2024-09-17T04:36:12.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.795+0000 7fc7c2ffd640 1 -- 172.21.15.43:0/3767145086 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7c80053c0 con 0x7fc7d4074540 2024-09-17T04:36:12.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.795+0000 7fc7c2ffd640 1 -- 172.21.15.43:0/3767145086 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8003850 con 0x7fc7d4074540 2024-09-17T04:36:12.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.795+0000 7fc7d8bdf640 1 -- 172.21.15.43:0/3767145086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d415bba0 con 0x7fc7d4074540 2024-09-17T04:36:12.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.795+0000 7fc7d8bdf640 1 -- 172.21.15.43:0/3767145086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d415c140 con 0x7fc7d4074540 2024-09-17T04:36:12.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.797+0000 7fc7d8bdf640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d414e7d0 0x7fc7d40c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.797+0000 7fc7d8bdf640 1 -- 172.21.15.43:0/3767145086 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d41f04a0 con 0x7fc7d414e7d0 2024-09-17T04:36:12.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.797+0000 7fc7d259c640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d414e7d0 0x7fc7d40c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.797+0000 7fc7d259c640 1 -- 172.21.15.43:0/3767145086 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc7d40ca360 con 0x7fc7d414e7d0 2024-09-17T04:36:12.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.798+0000 7fc7d259c640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d414e7d0 0x7fc7d40c9930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4010640 tx=0x7fc7c4010b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:12.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.798+0000 7fc7c2ffd640 1 -- 172.21.15.43:0/3767145086 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4004220 con 0x7fc7d414e7d0 2024-09-17T04:36:12.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.798+0000 7fc7c2ffd640 1 -- 172.21.15.43:0/3767145086 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc7c801a070 con 0x7fc7d4074540 2024-09-17T04:36:12.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.798+0000 7fc7c2ffd640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc7b4078a90 0x7fc7b407afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.798+0000 7fc7c2ffd640 1 -- 172.21.15.43:0/3767145086 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5833+0+0 (secure 0 0 0) 0x7fc7c809a0e0 con 0x7fc7d4074540 2024-09-17T04:36:12.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.798+0000 7fc7d2d9d640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc7b4078a90 0x7fc7b407afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.799+0000 7fc7c2ffd640 1 -- 172.21.15.43:0/3767145086 <== mon.2 v2:172.21.15.62:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc7c40043c0 con 0x7fc7d414e7d0 2024-09-17T04:36:12.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.799+0000 7fc7c2ffd640 1 -- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d414e7d0 msgr2=0x7fc7d40c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.799+0000 7fc7c2ffd640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d414e7d0 0x7fc7d40c9930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4010640 tx=0x7fc7c4010b00 comp rx=0 tx=0).stop 2024-09-17T04:36:12.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.799+0000 7fc7c2ffd640 1 -- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d414e7d0 msgr2=0x7fc7d40c9930 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:36:12.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.799+0000 7fc7c2ffd640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d414e7d0 0x7fc7d40c9930 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.799+0000 7fc7d2d9d640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc7b4078a90 0x7fc7b407afa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc035000 tx=0x7fc7cc038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:12.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.805+0000 7fc7d8bdf640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d4070630 0x7fc7d4070a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:36:12.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.805+0000 7fc7d8bdf640 1 -- 172.21.15.43:0/3767145086 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d40c7e70 con 0x7fc7d4070630 2024-09-17T04:36:12.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.805+0000 7fc7d259c640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d4070630 0x7fc7d4070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:36:12.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.806+0000 7fc7d259c640 1 -- 172.21.15.43:0/3767145086 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc7d40cb520 con 0x7fc7d4070630 2024-09-17T04:36:12.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.806+0000 7fc7d259c640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d4070630 0x7fc7d4070a40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4010640 tx=0x7fc7c40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:36:12.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.806+0000 7fc7c2ffd640 1 -- 172.21.15.43:0/3767145086 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4020df0 con 0x7fc7d4070630 2024-09-17T04:36:12.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.807+0000 7fc7c2ffd640 1 -- 172.21.15.43:0/3767145086 <== mon.2 v2:172.21.15.62:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7fc7c40035f0 con 0x7fc7d4070630 2024-09-17T04:36:12.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.807+0000 7fc7c2ffd640 1 -- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d4070630 msgr2=0x7fc7d4070a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.807+0000 7fc7c2ffd640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d4070630 0x7fc7d4070a40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4010640 tx=0x7fc7c40046c0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.807 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-17T04:36:12.807 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "c", 2024-09-17T04:36:12.807 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 2, 2024-09-17T04:36:12.807 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "peon", 2024-09-17T04:36:12.807 INFO:teuthology.orchestra.run.smithi043.stdout: "election_epoch": 10, 2024-09-17T04:36:12.807 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 12240, 2024-09-17T04:36:12.808 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum": [ 2024-09-17T04:36:12.808 INFO:teuthology.orchestra.run.smithi043.stdout: 0, 2024-09-17T04:36:12.808 INFO:teuthology.orchestra.run.smithi043.stdout: 1, 2024-09-17T04:36:12.808 INFO:teuthology.orchestra.run.smithi043.stdout: 2 2024-09-17T04:36:12.808 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.808 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_age": 12, 2024-09-17T04:36:12.808 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:36:12.808 INFO:teuthology.orchestra.run.smithi043.stdout: "required_con": "2450521708007866372", 2024-09-17T04:36:12.808 INFO:teuthology.orchestra.run.smithi043.stdout: "required_mon": [ 2024-09-17T04:36:12.808 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:12.808 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:12.808 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:12.809 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:12.809 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:12.809 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:12.809 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:12.809 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:12.809 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:12.809 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:12.809 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:12.809 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.809 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_con": "4540719139924082687", 2024-09-17T04:36:12.809 INFO:teuthology.orchestra.run.smithi043.stdout: "quorum_mon": [ 2024-09-17T04:36:12.809 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:12.809 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:12.810 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:12.810 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:12.810 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:12.810 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:12.810 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:12.810 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:12.810 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:12.810 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:12.810 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:12.810 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.810 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.810 INFO:teuthology.orchestra.run.smithi043.stdout: "outside_quorum": [], 2024-09-17T04:36:12.810 INFO:teuthology.orchestra.run.smithi043.stdout: "extra_probe_peers": [], 2024-09-17T04:36:12.810 INFO:teuthology.orchestra.run.smithi043.stdout: "sync_provider": [], 2024-09-17T04:36:12.811 INFO:teuthology.orchestra.run.smithi043.stdout: "monmap": { 2024-09-17T04:36:12.811 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 1, 2024-09-17T04:36:12.811 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "cdef1e3e-07e6-43e6-b635-3ed1bc15d64a", 2024-09-17T04:36:12.811 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:36:12.811 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-09-17T04:33:51.199044Z", 2024-09-17T04:36:12.811 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release": 19, 2024-09-17T04:36:12.811 INFO:teuthology.orchestra.run.smithi043.stdout: "min_mon_release_name": "squid", 2024-09-17T04:36:12.811 INFO:teuthology.orchestra.run.smithi043.stdout: "election_strategy": 1, 2024-09-17T04:36:12.811 INFO:teuthology.orchestra.run.smithi043.stdout: "disallowed_leaders: ": "", 2024-09-17T04:36:12.811 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false, 2024-09-17T04:36:12.811 INFO:teuthology.orchestra.run.smithi043.stdout: "tiebreaker_mon": "", 2024-09-17T04:36:12.811 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_ranks: ": "", 2024-09-17T04:36:12.811 INFO:teuthology.orchestra.run.smithi043.stdout: "features": { 2024-09-17T04:36:12.812 INFO:teuthology.orchestra.run.smithi043.stdout: "persistent": [ 2024-09-17T04:36:12.812 INFO:teuthology.orchestra.run.smithi043.stdout: "kraken", 2024-09-17T04:36:12.812 INFO:teuthology.orchestra.run.smithi043.stdout: "luminous", 2024-09-17T04:36:12.812 INFO:teuthology.orchestra.run.smithi043.stdout: "mimic", 2024-09-17T04:36:12.812 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap-prune", 2024-09-17T04:36:12.812 INFO:teuthology.orchestra.run.smithi043.stdout: "nautilus", 2024-09-17T04:36:12.812 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus", 2024-09-17T04:36:12.812 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific", 2024-09-17T04:36:12.812 INFO:teuthology.orchestra.run.smithi043.stdout: "elector-pinging", 2024-09-17T04:36:12.812 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy", 2024-09-17T04:36:12.812 INFO:teuthology.orchestra.run.smithi043.stdout: "reef", 2024-09-17T04:36:12.812 INFO:teuthology.orchestra.run.smithi043.stdout: "squid" 2024-09-17T04:36:12.812 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.813 INFO:teuthology.orchestra.run.smithi043.stdout: "optional": [] 2024-09-17T04:36:12.813 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.813 INFO:teuthology.orchestra.run.smithi043.stdout: "mons": [ 2024-09-17T04:36:12.813 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.813 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 0, 2024-09-17T04:36:12.813 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "a", 2024-09-17T04:36:12.813 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:12.813 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:12.813 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.813 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:12.813 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:3300", 2024-09-17T04:36:12.813 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.813 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.813 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.814 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:12.814 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789", 2024-09-17T04:36:12.814 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.814 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.814 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.814 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.814 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6789/0", 2024-09-17T04:36:12.814 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.43:6789/0", 2024-09-17T04:36:12.814 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:12.814 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:12.814 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:12.814 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.814 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.814 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 1, 2024-09-17T04:36:12.815 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "b", 2024-09-17T04:36:12.815 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:12.815 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:12.815 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.815 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:12.815 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3300", 2024-09-17T04:36:12.815 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.815 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.815 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.815 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:12.815 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789", 2024-09-17T04:36:12.815 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.815 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.815 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.816 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.816 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6789/0", 2024-09-17T04:36:12.816 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6789/0", 2024-09-17T04:36:12.816 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:12.816 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:12.816 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:12.816 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.816 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.816 INFO:teuthology.orchestra.run.smithi043.stdout: "rank": 2, 2024-09-17T04:36:12.816 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "c", 2024-09-17T04:36:12.816 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-09-17T04:36:12.816 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-09-17T04:36:12.816 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.817 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-09-17T04:36:12.817 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:3301", 2024-09-17T04:36:12.817 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.817 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.817 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.817 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-09-17T04:36:12.817 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790", 2024-09-17T04:36:12.817 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 0 2024-09-17T04:36:12.817 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.817 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.817 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.817 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.62:6790/0", 2024-09-17T04:36:12.817 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.62:6790/0", 2024-09-17T04:36:12.817 INFO:teuthology.orchestra.run.smithi043.stdout: "priority": 0, 2024-09-17T04:36:12.818 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0, 2024-09-17T04:36:12.818 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "{}" 2024-09-17T04:36:12.818 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.818 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.818 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.818 INFO:teuthology.orchestra.run.smithi043.stdout: "feature_map": { 2024-09-17T04:36:12.818 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": [ 2024-09-17T04:36:12.818 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.818 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:12.818 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:12.818 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:36:12.818 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.818 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-17T04:36:12.818 INFO:teuthology.orchestra.run.smithi043.stdout: "client": [ 2024-09-17T04:36:12.818 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-17T04:36:12.819 INFO:teuthology.orchestra.run.smithi043.stdout: "features": "0x3f03dffffffdffff", 2024-09-17T04:36:12.819 INFO:teuthology.orchestra.run.smithi043.stdout: "release": "squid", 2024-09-17T04:36:12.819 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 1 2024-09-17T04:36:12.819 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-17T04:36:12.819 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-17T04:36:12.819 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-17T04:36:12.819 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": false 2024-09-17T04:36:12.819 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-17T04:36:12.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.807+0000 7fc7c2ffd640 1 -- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d4070630 msgr2=0x7fc7d4070a40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T04:36:12.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.807+0000 7fc7c2ffd640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d4070630 0x7fc7d4070a40 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4010640 tx=0x7fc7c40046c0 comp rx=0 tx=0).stop 2024-09-17T04:36:12.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.807+0000 7fc7c0ff9640 1 -- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc7b4078a90 msgr2=0x7fc7b407afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.807+0000 7fc7c0ff9640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc7b4078a90 0x7fc7b407afa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc035000 tx=0x7fc7cc038040 comp rx=0 tx=0).stop 2024-09-17T04:36:12.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.807+0000 7fc7c0ff9640 1 -- 172.21.15.43:0/3767145086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7d4074540 msgr2=0x7fc7d41efa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:36:12.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.807+0000 7fc7c0ff9640 1 --2- 172.21.15.43:0/3767145086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7d4074540 0x7fc7d41efa90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800c3d0 tx=0x7fc7c800c890 comp rx=0 tx=0).stop 2024-09-17T04:36:12.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.807+0000 7fc7d2d9d640 1 -- 172.21.15.43:0/3767145086 reap_dead start 2024-09-17T04:36:12.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.807+0000 7fc7d2d9d640 1 -- 172.21.15.43:0/3767145086 reap_dead start 2024-09-17T04:36:12.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.807+0000 7fc7c0ff9640 1 -- 172.21.15.43:0/3767145086 shutdown_connections 2024-09-17T04:36:12.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.807+0000 7fc7c0ff9640 1 -- 172.21.15.43:0/3767145086 >> 172.21.15.43:0/3767145086 conn(0x7fc7d406cdb0 msgr2=0x7fc7d40cd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:36:12.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.807+0000 7fc7c0ff9640 1 -- 172.21.15.43:0/3767145086 shutdown_connections 2024-09-17T04:36:12.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:36:12.808+0000 7fc7c0ff9640 1 -- 172.21.15.43:0/3767145086 wait complete. 2024-09-17T04:36:12.822 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-17T04:36:12.822 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-17T04:36:12.822 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2024-09-17T04:36:12.822 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-17T04:36:12.822 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-17T04:36:12.823 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T04:36:12.823 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:36:12.841 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T04:36:12.841 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-09-17T04:36:12.841 INFO:tasks.ceph.mon.c:Sent signal 19 2024-09-17T04:36:12.841 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-17T04:36:19.589 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:36:19.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:36:20.892 INFO:tasks.workunit.client.0.smithi043.stderr:Updating files: 91% (11559/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-17T04:36:21.805 INFO:tasks.workunit.client.0.smithi043.stderr:Note: switching to 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'. 2024-09-17T04:36:21.806 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-17T04:36:21.806 INFO:tasks.workunit.client.0.smithi043.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T04:36:21.806 INFO:tasks.workunit.client.0.smithi043.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T04:36:21.806 INFO:tasks.workunit.client.0.smithi043.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T04:36:21.806 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-17T04:36:21.807 INFO:tasks.workunit.client.0.smithi043.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T04:36:21.807 INFO:tasks.workunit.client.0.smithi043.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T04:36:21.807 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-17T04:36:21.807 INFO:tasks.workunit.client.0.smithi043.stderr: git switch -c 2024-09-17T04:36:21.808 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-17T04:36:21.808 INFO:tasks.workunit.client.0.smithi043.stderr:Or undo this operation with: 2024-09-17T04:36:21.808 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-17T04:36:21.809 INFO:tasks.workunit.client.0.smithi043.stderr: git switch - 2024-09-17T04:36:21.809 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-17T04:36:21.809 INFO:tasks.workunit.client.0.smithi043.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T04:36:21.809 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-17T04:36:21.809 INFO:tasks.workunit.client.0.smithi043.stderr:HEAD is now at ce1b342bf8c Merge PR #55006 into wip-pdonnell-testing-20240916.200549-debug 2024-09-17T04:36:21.811 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-17T04:36:21.833 INFO:tasks.workunit.client.0.smithi043.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T04:36:21.835 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T04:36:21.835 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T04:36:22.481 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T04:36:22.552 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T04:36:22.595 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T04:36:22.596 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T04:36:22.596 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T04:36:22.638 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T04:36:22.641 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:36:22.641 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-17T04:36:22.714 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2024-09-17T04:36:22.716 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2024-09-17T04:36:22.716 DEBUG:teuthology.orchestra.run.smithi043:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ce1b342bf8c6349a8c90cd607f83bff2443f21cf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2024-09-17T04:36:24.583 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T04:36:24.583 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-17T04:36:27.842 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-09-17T04:36:27.843 INFO:tasks.ceph.mon.c:Sent signal 18 2024-09-17T04:36:27.843 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-17T04:36:27.843 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-17T04:36:33.119 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2024-09-17T04:36:33.119 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-17T04:36:33.425 DEBUG:teuthology.parallel:result is None 2024-09-17T04:36:33.426 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T04:36:33.459 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T04:36:33.459 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-09-17T04:36:33.468 INFO:tasks.mon_thrash:joining mon_thrasher 2024-09-17T04:36:49.666 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:36:49.669 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:37:19.726 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:37:19.730 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:37:49.789 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:37:49.793 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:38:19.866 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:38:19.870 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:38:27.880 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-17T04:38:27.881 ERROR:tasks.mon_thrash.mon_thrasher:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/mon_thrash.py", line 272, in do_thrash self._do_thrash() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/mon_thrash.py", line 365, in _do_thrash self.manager.wait_for_mon_quorum_size(len(mons)-len(mons_to_kill)) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 3274, in wait_for_mon_quorum_size if len(self.get_mon_quorum()) == size: File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 3251, in get_mon_quorum out = self.raw_cluster_cmd('quorum_status') File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 1696, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 1687, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi043 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status' 2024-09-17T04:38:27.883 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-17T04:38:27.883 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-17T04:38:32.154 INFO:tasks.daemonwatchdog.daemon_watchdog:MonitorThrasher failed 2024-09-17T04:38:32.154 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-09-17T04:38:32.154 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:38:32.154 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:38:32.175 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:38:32.175 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:38:32.235 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T04:38:49.931 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:38:49.935 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:39:19.999 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:39:20.003 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:39:50.063 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:39:50.067 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:40:20.137 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:40:20.142 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:40:27.920 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-17T04:40:27.921 ERROR:teuthology.run_tasks:Manager failed: mon_thrash Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/mon_thrash.py", line 468, in task manager.wait_for_mon_quorum_size(len(mons)) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 3274, in wait_for_mon_quorum_size if len(self.get_mon_quorum()) == size: File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 3251, in get_mon_quorum out = self.raw_cluster_cmd('quorum_status') File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 1696, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 1687, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi043 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status' 2024-09-17T04:40:27.922 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-17T04:40:27.932 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-17T04:40:27.932 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:40:27.932 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:40:27.952 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:40:27.952 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:40:28.013 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T04:40:32.316 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-17T04:40:32.317 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls 2024-09-17T04:40:50.201 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:40:50.205 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:41:20.265 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:41:20.269 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:41:50.337 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:41:50.342 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:42:20.402 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:42:20.405 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:42:28.091 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-17T04:42:28.092 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls 2024-09-17T04:42:31.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.384+0000 7f5696427640 1 -- 172.21.15.43:0/438797806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f567c005330 msgr2=0x7f567c00b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:31.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.384+0000 7f5696427640 1 --2- 172.21.15.43:0/438797806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f567c005330 0x7f567c00b9e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f569008ec20 tx=0x7f567c005830 comp rx=0 tx=0).stop 2024-09-17T04:42:31.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.384+0000 7f5696427640 1 -- 172.21.15.43:0/438797806 shutdown_connections 2024-09-17T04:42:31.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.384+0000 7f5696427640 1 --2- 172.21.15.43:0/438797806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f567c005330 0x7f567c00b9e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:31.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.384+0000 7f5696427640 1 --2- 172.21.15.43:0/438797806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c004800 0x7f567c004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:31.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.384+0000 7f5696427640 1 --2- 172.21.15.43:0/438797806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567c0039b0 0x7f567c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:31.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.384+0000 7f5696427640 1 -- 172.21.15.43:0/438797806 >> 172.21.15.43:0/438797806 conn(0x7f569006f4e0 msgr2=0x7f569006f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:42:31.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.384+0000 7f5696427640 1 -- 172.21.15.43:0/438797806 shutdown_connections 2024-09-17T04:42:31.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.384+0000 7f5696427640 1 -- 172.21.15.43:0/438797806 wait complete. 2024-09-17T04:42:31.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.386+0000 7f5696427640 1 Processor -- start 2024-09-17T04:42:31.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.387+0000 7f5696427640 1 -- start start 2024-09-17T04:42:31.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.388+0000 7f5696427640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f567c0039b0 0x7f56900acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:31.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.388+0000 7f5696427640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567c004800 0x7f56901f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:31.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.388+0000 7f5696427640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c005330 0x7f56900c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:31.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.388+0000 7f5696427640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f569015b990 con 0x7f567c005330 2024-09-17T04:42:31.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.388+0000 7f5696427640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f569015c020 con 0x7f567c0039b0 2024-09-17T04:42:31.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.388+0000 7f5696427640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f56900ccbd0 con 0x7f567c004800 2024-09-17T04:42:31.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.388+0000 7f56949c4640 1 -- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c005330 msgr2=0x7f56900c6520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:3300/0 2024-09-17T04:42:31.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.388+0000 7f56949c4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c005330 0x7f56900c6520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:42:31.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.388+0000 7f568f7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567c004800 0x7f56901f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.388+0000 7f568ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f567c0039b0 0x7f56900acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.388+0000 7f568f7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567c004800 0x7f56901f5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:58234/0 (socket says 172.21.15.43:58234) 2024-09-17T04:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.388+0000 7f568ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f567c0039b0 0x7f56900acdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:39612/0 (socket says 172.21.15.43:39612) 2024-09-17T04:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.388+0000 7f568f7fe640 1 -- 172.21.15.43:0/1760091560 learned_addr learned my addr 172.21.15.43:0/1760091560 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.389+0000 7f568f7fe640 1 -- 172.21.15.43:0/1760091560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f567c0039b0 msgr2=0x7f56900acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.389+0000 7f568f7fe640 1 --2- 172.21.15.43:0/1760091560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f567c0039b0 0x7f56900acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.389+0000 7f568f7fe640 1 -- 172.21.15.43:0/1760091560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c005330 msgr2=0x7f56900c6520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.389+0000 7f568f7fe640 1 --2- 172.21.15.43:0/1760091560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c005330 0x7f56900c6520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.389+0000 7f568f7fe640 1 -- 172.21.15.43:0/1760091560 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56900c7ec0 con 0x7f567c004800 2024-09-17T04:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.389+0000 7f568f7fe640 1 --2- 172.21.15.43:0/1760091560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567c004800 0x7f56901f5120 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f567800d670 tx=0x7f567800db30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:42:31.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.389+0000 7f568cff9640 1 -- 172.21.15.43:0/1760091560 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678017070 con 0x7f567c004800 2024-09-17T04:42:31.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.389+0000 7f568cff9640 1 -- 172.21.15.43:0/1760091560 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5678009b10 con 0x7f567c004800 2024-09-17T04:42:31.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.389+0000 7f568cff9640 1 -- 172.21.15.43:0/1760091560 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678010460 con 0x7f567c004800 2024-09-17T04:42:31.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.389+0000 7f5696427640 1 -- 172.21.15.43:0/1760091560 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56900c5c30 con 0x7f567c004800 2024-09-17T04:42:31.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.390+0000 7f5696427640 1 -- 172.21.15.43:0/1760091560 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f56900c5ed0 con 0x7f567c004800 2024-09-17T04:42:31.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.391+0000 7f5696427640 1 -- 172.21.15.43:0/1760091560 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f569015fb00 con 0x7f567c004800 2024-09-17T04:42:31.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.391+0000 7f568cff9640 1 -- 172.21.15.43:0/1760091560 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f567801a070 con 0x7f567c004800 2024-09-17T04:42:31.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.392+0000 7f568cff9640 1 --2- 172.21.15.43:0/1760091560 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56700792e0 0x7f567007b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:31.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.392+0000 7f568cff9640 1 -- 172.21.15.43:0/1760091560 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5833+0+0 (secure 0 0 0) 0x7f567809acf0 con 0x7f567c004800 2024-09-17T04:42:31.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.392+0000 7f568ffff640 1 --2- 172.21.15.43:0/1760091560 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56700792e0 0x7f567007b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:42:31.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.393+0000 7f568ffff640 1 --2- 172.21.15.43:0/1760091560 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56700792e0 0x7f567007b7f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5680005940 tx=0x7f5680015040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:42:31.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.397+0000 7f568cff9640 1 -- 172.21.15.43:0/1760091560 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f567809f070 con 0x7f567c004800 2024-09-17T04:42:31.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.597+0000 7f5696427640 1 -- 172.21.15.43:0/1760091560 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd blacklist ls"} v 0) -- 0x7f569015b530 con 0x7f567c004800 2024-09-17T04:42:31.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.598+0000 7f568cff9640 1 -- 172.21.15.43:0/1760091560 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f5678021030 con 0x7f567c004800 2024-09-17T04:42:31.598 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2024-09-17T04:42:31.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.600+0000 7f5696427640 1 -- 172.21.15.43:0/1760091560 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56700792e0 msgr2=0x7f567007b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:31.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.600+0000 7f5696427640 1 --2- 172.21.15.43:0/1760091560 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56700792e0 0x7f567007b7f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5680005940 tx=0x7f5680015040 comp rx=0 tx=0).stop 2024-09-17T04:42:31.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.600+0000 7f5696427640 1 -- 172.21.15.43:0/1760091560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567c004800 msgr2=0x7f56901f5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:31.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.600+0000 7f5696427640 1 --2- 172.21.15.43:0/1760091560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567c004800 0x7f56901f5120 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f567800d670 tx=0x7f567800db30 comp rx=0 tx=0).stop 2024-09-17T04:42:31.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.600+0000 7f5696427640 1 -- 172.21.15.43:0/1760091560 shutdown_connections 2024-09-17T04:42:31.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.600+0000 7f5696427640 1 --2- 172.21.15.43:0/1760091560 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f56700792e0 0x7f567007b7f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:31.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.600+0000 7f5696427640 1 --2- 172.21.15.43:0/1760091560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c005330 0x7f56900c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:31.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.600+0000 7f5696427640 1 --2- 172.21.15.43:0/1760091560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567c004800 0x7f56901f5120 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:31.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.600+0000 7f5696427640 1 --2- 172.21.15.43:0/1760091560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f567c0039b0 0x7f56900acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:31.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.600+0000 7f5696427640 1 -- 172.21.15.43:0/1760091560 >> 172.21.15.43:0/1760091560 conn(0x7f569006f4e0 msgr2=0x7f569015eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:42:31.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.600+0000 7f5696427640 1 -- 172.21.15.43:0/1760091560 shutdown_connections 2024-09-17T04:42:31.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:31.600+0000 7f5696427640 1 -- 172.21.15.43:0/1760091560 wait complete. 2024-09-17T04:42:31.611 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T04:42:31.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:42:31.612 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T04:42:31.658 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T04:42:31.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:42:31.658 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T04:42:31.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:42:31.694 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-09-17T04:42:31.751 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T04:42:31.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:42:31.751 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T04:42:31.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:42:31.818 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-09-17T04:42:31.928 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-17T04:42:31.928 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:42:31.928 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:42:31.944 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056794,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 2024-09-17T04:42:31.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:42:31.945 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-09-17T04:42:32.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:42:32.003 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-09-17T04:42:32.071 INFO:teuthology.orchestra.run.smithi043.stderr:Cannot find device "ceph-brx" 2024-09-17T04:42:32.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:42:32.073 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T04:42:32.083 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T04:42:32.083 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:42:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.231+0000 7fc684177640 1 -- 172.21.15.43:0/2740250951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc67c0c5f50 msgr2=0x7fc67c153a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.231+0000 7fc684177640 1 --2- 172.21.15.43:0/2740250951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc67c0c5f50 0x7fc67c153a50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0ccbb0 tx=0x7fc67802a610 comp rx=0 tx=0).stop 2024-09-17T04:42:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.231+0000 7fc684177640 1 -- 172.21.15.43:0/2740250951 shutdown_connections 2024-09-17T04:42:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.231+0000 7fc684177640 1 --2- 172.21.15.43:0/2740250951 >> v2:172.21.15.43:3300/0 conn(0x7fc67c0c4030 0x7fc67c071630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.231+0000 7fc684177640 1 --2- 172.21.15.43:0/2740250951 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc67c0c4440 0x7fc67c071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.231+0000 7fc684177640 1 --2- 172.21.15.43:0/2740250951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc67c0c5f50 0x7fc67c153a50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.231+0000 7fc684177640 1 -- 172.21.15.43:0/2740250951 >> 172.21.15.43:0/2740250951 conn(0x7fc67c072f60 msgr2=0x7fc67c0cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:42:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.232+0000 7fc684177640 1 -- 172.21.15.43:0/2740250951 shutdown_connections 2024-09-17T04:42:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.232+0000 7fc684177640 1 -- 172.21.15.43:0/2740250951 wait complete. 2024-09-17T04:42:32.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.233+0000 7fc684177640 1 Processor -- start 2024-09-17T04:42:32.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.233+0000 7fc684177640 1 -- start start 2024-09-17T04:42:32.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.234+0000 7fc684177640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc67c0c4030 0x7fc67c1e3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:32.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.234+0000 7fc684177640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc67c0c4440 0x7fc67c1f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:32.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.234+0000 7fc684177640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc67c0c5f50 0x7fc67c147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:32.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.234+0000 7fc684177640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc67c0c9a10 con 0x7fc67c0c4440 2024-09-17T04:42:32.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.234+0000 7fc684177640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc67c15db10 con 0x7fc67c0c5f50 2024-09-17T04:42:32.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.234+0000 7fc684177640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc67c070280 con 0x7fc67c0c4030 2024-09-17T04:42:32.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.235+0000 7fc681712640 1 -- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc67c0c4440 msgr2=0x7fc67c1f3f10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:3300/0 2024-09-17T04:42:32.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.235+0000 7fc681712640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc67c0c4440 0x7fc67c1f3f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:42:32.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.235+0000 7fc681f13640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc67c0c4030 0x7fc67c1e3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:42:32.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.235+0000 7fc682714640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc67c0c5f50 0x7fc67c147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:42:32.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.235+0000 7fc681f13640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc67c0c4030 0x7fc67c1e3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:58256/0 (socket says 172.21.15.43:58256) 2024-09-17T04:42:32.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.235+0000 7fc681f13640 1 -- 172.21.15.43:0/2607883879 learned_addr learned my addr 172.21.15.43:0/2607883879 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:42:32.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.235+0000 7fc682714640 1 -- 172.21.15.43:0/2607883879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc67c0c4030 msgr2=0x7fc67c1e3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:32.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.235+0000 7fc682714640 1 --2- 172.21.15.43:0/2607883879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc67c0c4030 0x7fc67c1e3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.235+0000 7fc682714640 1 -- 172.21.15.43:0/2607883879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc67c0c4440 msgr2=0x7fc67c1f3f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:42:32.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.235+0000 7fc682714640 1 --2- 172.21.15.43:0/2607883879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc67c0c4440 0x7fc67c1f3f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.235+0000 7fc682714640 1 -- 172.21.15.43:0/2607883879 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc67c1f4450 con 0x7fc67c0c5f50 2024-09-17T04:42:32.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.235+0000 7fc682714640 1 --2- 172.21.15.43:0/2607883879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc67c0c5f50 0x7fc67c147690 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc674005fd0 tx=0x7fc67400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:42:32.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.235+0000 7fc6727fc640 1 -- 172.21.15.43:0/2607883879 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc674010630 con 0x7fc67c0c5f50 2024-09-17T04:42:32.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.236+0000 7fc6727fc640 1 -- 172.21.15.43:0/2607883879 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc67400ee90 con 0x7fc67c0c5f50 2024-09-17T04:42:32.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.236+0000 7fc684177640 1 -- 172.21.15.43:0/2607883879 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc67c1e2c80 con 0x7fc67c0c5f50 2024-09-17T04:42:32.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.236+0000 7fc6727fc640 1 -- 172.21.15.43:0/2607883879 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc674010a50 con 0x7fc67c0c5f50 2024-09-17T04:42:32.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.236+0000 7fc684177640 1 -- 172.21.15.43:0/2607883879 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc67c1f39f0 con 0x7fc67c0c5f50 2024-09-17T04:42:32.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.236+0000 7fc684177640 1 -- 172.21.15.43:0/2607883879 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc67c153a50 con 0x7fc67c0c5f50 2024-09-17T04:42:32.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.238+0000 7fc6727fc640 1 -- 172.21.15.43:0/2607883879 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc674010bf0 con 0x7fc67c0c5f50 2024-09-17T04:42:32.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.238+0000 7fc6727fc640 1 --2- 172.21.15.43:0/2607883879 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc660078b40 0x7fc66007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:32.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.238+0000 7fc6727fc640 1 -- 172.21.15.43:0/2607883879 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5833+0+0 (secure 0 0 0) 0x7fc67409bca0 con 0x7fc67c0c5f50 2024-09-17T04:42:32.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.238+0000 7fc681f13640 1 --2- 172.21.15.43:0/2607883879 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc660078b40 0x7fc66007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:42:32.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.239+0000 7fc681f13640 1 --2- 172.21.15.43:0/2607883879 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc660078b40 0x7fc66007b050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc678009230 tx=0x7fc678004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:42:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.242+0000 7fc6727fc640 1 -- 172.21.15.43:0/2607883879 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc674064140 con 0x7fc67c0c5f50 2024-09-17T04:42:32.353 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-17T04:42:32.353 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2024-09-17T04:42:32.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:42:32.354 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2024-09-17T04:42:32.378 INFO:teuthology.orchestra.run.smithi043.stderr:umount: /home/ubuntu/cephtest/mnt.0: no mount point specified. 2024-09-17T04:42:32.379 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-17T04:42:32.380 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T04:42:32.380 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:42:32.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.425+0000 7fc684177640 1 -- 172.21.15.43:0/2607883879 --> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc67c14f230 con 0x7fc660078b40 2024-09-17T04:42:32.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.431+0000 7fc6727fc640 1 -- 172.21.15.43:0/2607883879 <== mgr.4100 v2:172.21.15.62:6800/1186143747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251891 (secure 0 0 0) 0x7fc67c14f230 con 0x7fc660078b40 2024-09-17T04:42:32.434 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:42:32.435 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-17T04:42:32.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.434+0000 7fc684177640 1 -- 172.21.15.43:0/2607883879 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc660078b40 msgr2=0x7fc66007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:32.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.434+0000 7fc684177640 1 --2- 172.21.15.43:0/2607883879 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc660078b40 0x7fc66007b050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc678009230 tx=0x7fc678004730 comp rx=0 tx=0).stop 2024-09-17T04:42:32.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.434+0000 7fc684177640 1 -- 172.21.15.43:0/2607883879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc67c0c5f50 msgr2=0x7fc67c147690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:32.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.434+0000 7fc684177640 1 --2- 172.21.15.43:0/2607883879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc67c0c5f50 0x7fc67c147690 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc674005fd0 tx=0x7fc67400c6a0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.434+0000 7fc684177640 1 -- 172.21.15.43:0/2607883879 shutdown_connections 2024-09-17T04:42:32.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.434+0000 7fc684177640 1 --2- 172.21.15.43:0/2607883879 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fc660078b40 0x7fc66007b050 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.434+0000 7fc684177640 1 --2- 172.21.15.43:0/2607883879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc67c0c5f50 0x7fc67c147690 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.434+0000 7fc684177640 1 --2- 172.21.15.43:0/2607883879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc67c0c4440 0x7fc67c1f3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.434+0000 7fc684177640 1 --2- 172.21.15.43:0/2607883879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc67c0c4030 0x7fc67c1e3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.434+0000 7fc684177640 1 -- 172.21.15.43:0/2607883879 >> 172.21.15.43:0/2607883879 conn(0x7fc67c072f60 msgr2=0x7fc67c149d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:42:32.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.434+0000 7fc684177640 1 -- 172.21.15.43:0/2607883879 shutdown_connections 2024-09-17T04:42:32.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.434+0000 7fc684177640 1 -- 172.21.15.43:0/2607883879 wait complete. 2024-09-17T04:42:32.440 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056794,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 2024-09-17T04:42:32.440 ERROR:tasks.daemonwatchdog.daemon_watchdog:ignoring exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/cephfs/mount.py", line 191, in is_blocked output = self.fs.get_ceph_cmd_stdout('osd blocklist ls') File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout return self.run_ceph_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd return self.mon_manager.run_cluster_cmd(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 1687, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi043 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/cephfs/kernel_mount.py", line 191, in umount_wait self.umount(force) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/cephfs/kernel_mount.py", line 152, in umount if self.is_blocked(): File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/cephfs/mount.py", line 194, in is_blocked output = self.fs.get_ceph_cmd_stdout('osd blacklist ls') File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout return self.run_ceph_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd return self.mon_manager.run_cluster_cmd(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 1687, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi043 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/daemonwatchdog.py", line 61, in bark mount.umount_wait(force=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/cephfs/kernel_mount.py", line 197, in umount_wait self._run_umount_lf() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/cephfs/mount.py", line 518, in _run_umount_lf return proc UnboundLocalError: local variable 'proc' referenced before assignment 2024-09-17T04:42:32.445 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2024-09-17T04:42:31.019697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":631676,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":272,"num_write_kb":1729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240280,"kb_used_data":3280,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734440,"statfs":{"total":773094113280,"available":772848066560,"internally_reserved":0,"allocated":3358720,"data_stored":1973368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003451"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642826+0000","last_change":"2024-09-17T04:34:52.082794+0000","last_active":"2024-09-17T04:39:01.642826+0000","last_peered":"2024-09-17T04:39:01.642826+0000","last_clean":"2024-09-17T04:39:01.642826+0000","last_became_active":"2024-09-17T04:34:52.081216+0000","last_became_peered":"2024-09-17T04:34:52.081216+0000","last_unstale":"2024-09-17T04:39:01.642826+0000","last_undegraded":"2024-09-17T04:39:01.642826+0000","last_fullsized":"2024-09-17T04:39:01.642826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:32.229667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.639259+0000","last_change":"2024-09-17T04:34:52.071762+0000","last_active":"2024-09-17T04:39:04.639259+0000","last_peered":"2024-09-17T04:39:04.639259+0000","last_clean":"2024-09-17T04:39:04.639259+0000","last_became_active":"2024-09-17T04:34:52.071488+0000","last_became_peered":"2024-09-17T04:34:52.071488+0000","last_unstale":"2024-09-17T04:39:04.639259+0000","last_undegraded":"2024-09-17T04:39:04.639259+0000","last_fullsized":"2024-09-17T04:39:04.639259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:00.729921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.640068+0000","last_change":"2024-09-17T04:34:52.073360+0000","last_active":"2024-09-17T04:39:04.640068+0000","last_peered":"2024-09-17T04:39:04.640068+0000","last_clean":"2024-09-17T04:39:04.640068+0000","last_became_active":"2024-09-17T04:34:52.073014+0000","last_became_peered":"2024-09-17T04:34:52.073014+0000","last_unstale":"2024-09-17T04:39:04.640068+0000","last_undegraded":"2024-09-17T04:39:04.640068+0000","last_fullsized":"2024-09-17T04:39:04.640068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:14.331608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:51.641358+0000","last_change":"2024-09-17T04:34:52.077679+0000","last_active":"2024-09-17T04:38:51.641358+0000","last_peered":"2024-09-17T04:38:51.641358+0000","last_clean":"2024-09-17T04:38:51.641358+0000","last_became_active":"2024-09-17T04:34:52.077306+0000","last_became_peered":"2024-09-17T04:34:52.077306+0000","last_unstale":"2024-09-17T04:38:51.641358+0000","last_undegraded":"2024-09-17T04:38:51.641358+0000","last_fullsized":"2024-09-17T04:38:51.641358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:44.967159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.649003+0000","last_change":"2024-09-17T04:34:52.075036+0000","last_active":"2024-09-17T04:39:51.649003+0000","last_peered":"2024-09-17T04:39:51.649003+0000","last_clean":"2024-09-17T04:39:51.649003+0000","last_became_active":"2024-09-17T04:34:52.074649+0000","last_became_peered":"2024-09-17T04:34:52.074649+0000","last_unstale":"2024-09-17T04:39:51.649003+0000","last_undegraded":"2024-09-17T04:39:51.649003+0000","last_fullsized":"2024-09-17T04:39:51.649003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:22.293746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.648728+0000","last_change":"2024-09-17T04:34:52.081059+0000","last_active":"2024-09-17T04:39:51.648728+0000","last_peered":"2024-09-17T04:39:51.648728+0000","last_clean":"2024-09-17T04:39:51.648728+0000","last_became_active":"2024-09-17T04:34:52.080677+0000","last_became_peered":"2024-09-17T04:34:52.080677+0000","last_unstale":"2024-09-17T04:39:51.648728+0000","last_undegraded":"2024-09-17T04:39:51.648728+0000","last_fullsized":"2024-09-17T04:39:51.648728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:52.404672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.648979+0000","last_change":"2024-09-17T04:34:52.071135+0000","last_active":"2024-09-17T04:39:51.648979+0000","last_peered":"2024-09-17T04:39:51.648979+0000","last_clean":"2024-09-17T04:39:51.648979+0000","last_became_active":"2024-09-17T04:34:52.070844+0000","last_became_peered":"2024-09-17T04:34:52.070844+0000","last_unstale":"2024-09-17T04:39:51.648979+0000","last_undegraded":"2024-09-17T04:39:51.648979+0000","last_fullsized":"2024-09-17T04:39:51.648979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:02.373675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:54.645651+0000","last_change":"2024-09-17T04:34:52.083343+0000","last_active":"2024-09-17T04:39:54.645651+0000","last_peered":"2024-09-17T04:39:54.645651+0000","last_clean":"2024-09-17T04:39:54.645651+0000","last_became_active":"2024-09-17T04:34:52.083008+0000","last_became_peered":"2024-09-17T04:34:52.083008+0000","last_unstale":"2024-09-17T04:39:54.645651+0000","last_undegraded":"2024-09-17T04:39:54.645651+0000","last_fullsized":"2024-09-17T04:39:54.645651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:02.710077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647730+0000","last_change":"2024-09-17T04:34:52.083331+0000","last_active":"2024-09-17T04:39:41.647730+0000","last_peered":"2024-09-17T04:39:41.647730+0000","last_clean":"2024-09-17T04:39:41.647730+0000","last_became_active":"2024-09-17T04:34:52.082984+0000","last_became_peered":"2024-09-17T04:34:52.082984+0000","last_unstale":"2024-09-17T04:39:41.647730+0000","last_undegraded":"2024-09-17T04:39:41.647730+0000","last_fullsized":"2024-09-17T04:39:41.647730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:56.779776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647120+0000","last_change":"2024-09-17T04:34:52.087207+0000","last_active":"2024-09-17T04:39:41.647120+0000","last_peered":"2024-09-17T04:39:41.647120+0000","last_clean":"2024-09-17T04:39:41.647120+0000","last_became_active":"2024-09-17T04:34:52.086885+0000","last_became_peered":"2024-09-17T04:34:52.086885+0000","last_unstale":"2024-09-17T04:39:41.647120+0000","last_undegraded":"2024-09-17T04:39:41.647120+0000","last_fullsized":"2024-09-17T04:39:41.647120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:52.121338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647093+0000","last_change":"2024-09-17T04:34:52.086309+0000","last_active":"2024-09-17T04:39:41.647093+0000","last_peered":"2024-09-17T04:39:41.647093+0000","last_clean":"2024-09-17T04:39:41.647093+0000","last_became_active":"2024-09-17T04:34:52.085996+0000","last_became_peered":"2024-09-17T04:34:52.085996+0000","last_unstale":"2024-09-17T04:39:41.647093+0000","last_undegraded":"2024-09-17T04:39:41.647093+0000","last_fullsized":"2024-09-17T04:39:41.647093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:58.004980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647237+0000","last_change":"2024-09-17T04:34:52.077080+0000","last_active":"2024-09-17T04:39:41.647237+0000","last_peered":"2024-09-17T04:39:41.647237+0000","last_clean":"2024-09-17T04:39:41.647237+0000","last_became_active":"2024-09-17T04:34:52.076756+0000","last_became_peered":"2024-09-17T04:34:52.076756+0000","last_unstale":"2024-09-17T04:39:41.647237+0000","last_undegraded":"2024-09-17T04:39:41.647237+0000","last_fullsized":"2024-09-17T04:39:41.647237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:48.044400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644400+0000","last_change":"2024-09-17T04:34:52.076609+0000","last_active":"2024-09-17T04:39:44.644400+0000","last_peered":"2024-09-17T04:39:44.644400+0000","last_clean":"2024-09-17T04:39:44.644400+0000","last_became_active":"2024-09-17T04:34:52.076277+0000","last_became_peered":"2024-09-17T04:34:52.076277+0000","last_unstale":"2024-09-17T04:39:44.644400+0000","last_undegraded":"2024-09-17T04:39:44.644400+0000","last_fullsized":"2024-09-17T04:39:44.644400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:28.537566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'3","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.643368+0000","last_change":"2024-09-17T04:34:52.076754+0000","last_active":"2024-09-17T04:39:34.643368+0000","last_peered":"2024-09-17T04:39:34.643368+0000","last_clean":"2024-09-17T04:39:34.643368+0000","last_became_active":"2024-09-17T04:34:52.076261+0000","last_became_peered":"2024-09-17T04:34:52.076261+0000","last_unstale":"2024-09-17T04:39:34.643368+0000","last_undegraded":"2024-09-17T04:39:34.643368+0000","last_fullsized":"2024-09-17T04:39:34.643368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:51.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.642967+0000","last_change":"2024-09-17T04:34:52.079161+0000","last_active":"2024-09-17T04:39:34.642967+0000","last_peered":"2024-09-17T04:39:34.642967+0000","last_clean":"2024-09-17T04:39:34.642967+0000","last_became_active":"2024-09-17T04:34:52.078782+0000","last_became_peered":"2024-09-17T04:34:52.078782+0000","last_unstale":"2024-09-17T04:39:34.642967+0000","last_undegraded":"2024-09-17T04:39:34.642967+0000","last_fullsized":"2024-09-17T04:39:34.642967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:06.894137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.646038+0000","last_change":"2024-09-17T04:34:52.070767+0000","last_active":"2024-09-17T04:39:31.646038+0000","last_peered":"2024-09-17T04:39:31.646038+0000","last_clean":"2024-09-17T04:39:31.646038+0000","last_became_active":"2024-09-17T04:34:52.070428+0000","last_became_peered":"2024-09-17T04:34:52.070428+0000","last_unstale":"2024-09-17T04:39:31.646038+0000","last_undegraded":"2024-09-17T04:39:31.646038+0000","last_fullsized":"2024-09-17T04:39:31.646038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:42.820391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.646123+0000","last_change":"2024-09-17T04:34:52.077238+0000","last_active":"2024-09-17T04:39:31.646123+0000","last_peered":"2024-09-17T04:39:31.646123+0000","last_clean":"2024-09-17T04:39:31.646123+0000","last_became_active":"2024-09-17T04:34:52.076897+0000","last_became_peered":"2024-09-17T04:34:52.076897+0000","last_unstale":"2024-09-17T04:39:31.646123+0000","last_undegraded":"2024-09-17T04:39:31.646123+0000","last_fullsized":"2024-09-17T04:39:31.646123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:27.431184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.643014+0000","last_change":"2024-09-17T04:34:52.080917+0000","last_active":"2024-09-17T04:39:34.643014+0000","last_peered":"2024-09-17T04:39:34.643014+0000","last_clean":"2024-09-17T04:39:34.643014+0000","last_became_active":"2024-09-17T04:34:52.080597+0000","last_became_peered":"2024-09-17T04:34:52.080597+0000","last_unstale":"2024-09-17T04:39:34.643014+0000","last_undegraded":"2024-09-17T04:39:34.643014+0000","last_fullsized":"2024-09-17T04:39:34.643014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:10.560075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.645213+0000","last_change":"2024-09-17T04:34:52.077284+0000","last_active":"2024-09-17T04:39:21.645213+0000","last_peered":"2024-09-17T04:39:21.645213+0000","last_clean":"2024-09-17T04:39:21.645213+0000","last_became_active":"2024-09-17T04:34:52.076950+0000","last_became_peered":"2024-09-17T04:34:52.076950+0000","last_unstale":"2024-09-17T04:39:21.645213+0000","last_undegraded":"2024-09-17T04:39:21.645213+0000","last_fullsized":"2024-09-17T04:39:21.645213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:06.361530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.644550+0000","last_change":"2024-09-17T04:34:52.083859+0000","last_active":"2024-09-17T04:39:21.644550+0000","last_peered":"2024-09-17T04:39:21.644550+0000","last_clean":"2024-09-17T04:39:21.644550+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:39:21.644550+0000","last_undegraded":"2024-09-17T04:39:21.644550+0000","last_fullsized":"2024-09-17T04:39:21.644550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:25.262925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.642080+0000","last_change":"2024-09-17T04:34:52.086460+0000","last_active":"2024-09-17T04:39:24.642080+0000","last_peered":"2024-09-17T04:39:24.642080+0000","last_clean":"2024-09-17T04:39:24.642080+0000","last_became_active":"2024-09-17T04:34:52.084848+0000","last_became_peered":"2024-09-17T04:34:52.084848+0000","last_unstale":"2024-09-17T04:39:24.642080+0000","last_undegraded":"2024-09-17T04:39:24.642080+0000","last_fullsized":"2024-09-17T04:39:24.642080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:22.927331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.644942+0000","last_change":"2024-09-17T04:34:52.080149+0000","last_active":"2024-09-17T04:39:21.644942+0000","last_peered":"2024-09-17T04:39:21.644942+0000","last_clean":"2024-09-17T04:39:21.644942+0000","last_became_active":"2024-09-17T04:34:52.079490+0000","last_became_peered":"2024-09-17T04:34:52.079490+0000","last_unstale":"2024-09-17T04:39:21.644942+0000","last_undegraded":"2024-09-17T04:39:21.644942+0000","last_fullsized":"2024-09-17T04:39:21.644942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:52.314715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.641891+0000","last_change":"2024-09-17T04:34:52.082765+0000","last_active":"2024-09-17T04:39:24.641891+0000","last_peered":"2024-09-17T04:39:24.641891+0000","last_clean":"2024-09-17T04:39:24.641891+0000","last_became_active":"2024-09-17T04:34:52.081049+0000","last_became_peered":"2024-09-17T04:34:52.081049+0000","last_unstale":"2024-09-17T04:39:24.641891+0000","last_undegraded":"2024-09-17T04:39:24.641891+0000","last_fullsized":"2024-09-17T04:39:24.641891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.762553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:11.643792+0000","last_change":"2024-09-17T04:34:52.086233+0000","last_active":"2024-09-17T04:39:11.643792+0000","last_peered":"2024-09-17T04:39:11.643792+0000","last_clean":"2024-09-17T04:39:11.643792+0000","last_became_active":"2024-09-17T04:34:52.085876+0000","last_became_peered":"2024-09-17T04:34:52.085876+0000","last_unstale":"2024-09-17T04:39:11.643792+0000","last_undegraded":"2024-09-17T04:39:11.643792+0000","last_fullsized":"2024-09-17T04:39:11.643792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:44.061677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640892+0000","last_change":"2024-09-17T04:34:52.079305+0000","last_active":"2024-09-17T04:39:14.640892+0000","last_peered":"2024-09-17T04:39:14.640892+0000","last_clean":"2024-09-17T04:39:14.640892+0000","last_became_active":"2024-09-17T04:34:52.078984+0000","last_became_peered":"2024-09-17T04:34:52.078984+0000","last_unstale":"2024-09-17T04:39:14.640892+0000","last_undegraded":"2024-09-17T04:39:14.640892+0000","last_fullsized":"2024-09-17T04:39:14.640892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:15.927488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:11.643367+0000","last_change":"2024-09-17T04:34:52.077495+0000","last_active":"2024-09-17T04:39:11.643367+0000","last_peered":"2024-09-17T04:39:11.643367+0000","last_clean":"2024-09-17T04:39:11.643367+0000","last_became_active":"2024-09-17T04:34:52.077167+0000","last_became_peered":"2024-09-17T04:34:52.077167+0000","last_unstale":"2024-09-17T04:39:11.643367+0000","last_undegraded":"2024-09-17T04:39:11.643367+0000","last_fullsized":"2024-09-17T04:39:11.643367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.411611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640431+0000","last_change":"2024-09-17T04:34:52.077389+0000","last_active":"2024-09-17T04:39:14.640431+0000","last_peered":"2024-09-17T04:39:14.640431+0000","last_clean":"2024-09-17T04:39:14.640431+0000","last_became_active":"2024-09-17T04:34:52.076993+0000","last_became_peered":"2024-09-17T04:34:52.076993+0000","last_unstale":"2024-09-17T04:39:14.640431+0000","last_undegraded":"2024-09-17T04:39:14.640431+0000","last_fullsized":"2024-09-17T04:39:14.640431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:18.540098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640877+0000","last_change":"2024-09-17T04:34:52.080545+0000","last_active":"2024-09-17T04:39:14.640877+0000","last_peered":"2024-09-17T04:39:14.640877+0000","last_clean":"2024-09-17T04:39:14.640877+0000","last_became_active":"2024-09-17T04:34:52.079930+0000","last_became_peered":"2024-09-17T04:34:52.079930+0000","last_unstale":"2024-09-17T04:39:14.640877+0000","last_undegraded":"2024-09-17T04:39:14.640877+0000","last_fullsized":"2024-09-17T04:39:14.640877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:50.491050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.640051+0000","last_change":"2024-09-17T04:34:52.083598+0000","last_active":"2024-09-17T04:39:04.640051+0000","last_peered":"2024-09-17T04:39:04.640051+0000","last_clean":"2024-09-17T04:39:04.640051+0000","last_became_active":"2024-09-17T04:34:52.083225+0000","last_became_peered":"2024-09-17T04:34:52.083225+0000","last_unstale":"2024-09-17T04:39:04.640051+0000","last_undegraded":"2024-09-17T04:39:04.640051+0000","last_fullsized":"2024-09-17T04:39:04.640051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:22.713546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:49.644963+0000","last_change":"2024-09-17T04:35:37.193329+0000","last_active":"2024-09-17T04:39:49.644963+0000","last_peered":"2024-09-17T04:39:49.644963+0000","last_clean":"2024-09-17T04:39:49.644963+0000","last_became_active":"2024-09-17T04:35:37.192946+0000","last_became_peered":"2024-09-17T04:35:37.192946+0000","last_unstale":"2024-09-17T04:39:49.644963+0000","last_undegraded":"2024-09-17T04:39:49.644963+0000","last_fullsized":"2024-09-17T04:39:49.644963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:08.179268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.639160+0000","last_change":"2024-09-17T04:34:52.082113+0000","last_active":"2024-09-17T04:39:04.639160+0000","last_peered":"2024-09-17T04:39:04.639160+0000","last_clean":"2024-09-17T04:39:04.639160+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:39:04.639160+0000","last_undegraded":"2024-09-17T04:39:04.639160+0000","last_fullsized":"2024-09-17T04:39:04.639160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:52.744564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642099+0000","last_change":"2024-09-17T04:34:52.083306+0000","last_active":"2024-09-17T04:39:01.642099+0000","last_peered":"2024-09-17T04:39:01.642099+0000","last_clean":"2024-09-17T04:39:01.642099+0000","last_became_active":"2024-09-17T04:34:52.082590+0000","last_became_peered":"2024-09-17T04:34:52.082590+0000","last_unstale":"2024-09-17T04:39:01.642099+0000","last_undegraded":"2024-09-17T04:39:01.642099+0000","last_fullsized":"2024-09-17T04:39:01.642099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:21.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.648446+0000","last_change":"2024-09-17T04:34:52.070155+0000","last_active":"2024-09-17T04:39:51.648446+0000","last_peered":"2024-09-17T04:39:51.648446+0000","last_clean":"2024-09-17T04:39:51.648446+0000","last_became_active":"2024-09-17T04:34:52.069498+0000","last_became_peered":"2024-09-17T04:34:52.069498+0000","last_unstale":"2024-09-17T04:39:51.648446+0000","last_undegraded":"2024-09-17T04:39:51.648446+0000","last_fullsized":"2024-09-17T04:39:51.648446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:24.539277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:54.645708+0000","last_change":"2024-09-17T04:34:51.074188+0000","last_active":"2024-09-17T04:39:54.645708+0000","last_peered":"2024-09-17T04:39:54.645708+0000","last_clean":"2024-09-17T04:39:54.645708+0000","last_became_active":"2024-09-17T04:34:51.073740+0000","last_became_peered":"2024-09-17T04:34:51.073740+0000","last_unstale":"2024-09-17T04:39:54.645708+0000","last_undegraded":"2024-09-17T04:39:54.645708+0000","last_fullsized":"2024-09-17T04:39:54.645708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:36.692687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:54.645926+0000","last_change":"2024-09-17T04:34:52.081048+0000","last_active":"2024-09-17T04:39:54.645926+0000","last_peered":"2024-09-17T04:39:54.645926+0000","last_clean":"2024-09-17T04:39:54.645926+0000","last_became_active":"2024-09-17T04:34:52.080703+0000","last_became_peered":"2024-09-17T04:34:52.080703+0000","last_unstale":"2024-09-17T04:39:54.645926+0000","last_undegraded":"2024-09-17T04:39:54.645926+0000","last_fullsized":"2024-09-17T04:39:54.645926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:05.164849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.648336+0000","last_change":"2024-09-17T04:34:51.078602+0000","last_active":"2024-09-17T04:39:51.648336+0000","last_peered":"2024-09-17T04:39:51.648336+0000","last_clean":"2024-09-17T04:39:51.648336+0000","last_became_active":"2024-09-17T04:34:51.078221+0000","last_became_peered":"2024-09-17T04:34:51.078221+0000","last_unstale":"2024-09-17T04:39:51.648336+0000","last_undegraded":"2024-09-17T04:39:51.648336+0000","last_fullsized":"2024-09-17T04:39:51.648336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:59.716216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644377+0000","last_change":"2024-09-17T04:34:51.077573+0000","last_active":"2024-09-17T04:39:44.644377+0000","last_peered":"2024-09-17T04:39:44.644377+0000","last_clean":"2024-09-17T04:39:44.644377+0000","last_became_active":"2024-09-17T04:34:51.077225+0000","last_became_peered":"2024-09-17T04:34:51.077225+0000","last_unstale":"2024-09-17T04:39:44.644377+0000","last_undegraded":"2024-09-17T04:39:44.644377+0000","last_fullsized":"2024-09-17T04:39:44.644377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:29.348927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644335+0000","last_change":"2024-09-17T04:34:52.074356+0000","last_active":"2024-09-17T04:39:44.644335+0000","last_peered":"2024-09-17T04:39:44.644335+0000","last_clean":"2024-09-17T04:39:44.644335+0000","last_became_active":"2024-09-17T04:34:52.072796+0000","last_became_peered":"2024-09-17T04:34:52.072796+0000","last_unstale":"2024-09-17T04:39:44.644335+0000","last_undegraded":"2024-09-17T04:39:44.644335+0000","last_fullsized":"2024-09-17T04:39:44.644335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:53.971839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647411+0000","last_change":"2024-09-17T04:34:51.074170+0000","last_active":"2024-09-17T04:39:41.647411+0000","last_peered":"2024-09-17T04:39:41.647411+0000","last_clean":"2024-09-17T04:39:41.647411+0000","last_became_active":"2024-09-17T04:34:51.073836+0000","last_became_peered":"2024-09-17T04:34:51.073836+0000","last_unstale":"2024-09-17T04:39:41.647411+0000","last_undegraded":"2024-09-17T04:39:41.647411+0000","last_fullsized":"2024-09-17T04:39:41.647411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:30.884002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644326+0000","last_change":"2024-09-17T04:34:52.078331+0000","last_active":"2024-09-17T04:39:44.644326+0000","last_peered":"2024-09-17T04:39:44.644326+0000","last_clean":"2024-09-17T04:39:44.644326+0000","last_became_active":"2024-09-17T04:34:52.078012+0000","last_became_peered":"2024-09-17T04:34:52.078012+0000","last_unstale":"2024-09-17T04:39:44.644326+0000","last_undegraded":"2024-09-17T04:39:44.644326+0000","last_fullsized":"2024-09-17T04:39:44.644326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:28.961571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647134+0000","last_change":"2024-09-17T04:34:51.077676+0000","last_active":"2024-09-17T04:39:41.647134+0000","last_peered":"2024-09-17T04:39:41.647134+0000","last_clean":"2024-09-17T04:39:41.647134+0000","last_became_active":"2024-09-17T04:34:51.076291+0000","last_became_peered":"2024-09-17T04:34:51.076291+0000","last_unstale":"2024-09-17T04:39:41.647134+0000","last_undegraded":"2024-09-17T04:39:41.647134+0000","last_fullsized":"2024-09-17T04:39:41.647134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:42.622688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:04.631764+0000","last_change":"2024-09-17T04:35:37.194320+0000","last_active":"2024-09-17T04:38:04.631764+0000","last_peered":"2024-09-17T04:38:04.631764+0000","last_clean":"2024-09-17T04:38:04.631764+0000","last_became_active":"2024-09-17T04:35:37.193979+0000","last_became_peered":"2024-09-17T04:35:37.193979+0000","last_unstale":"2024-09-17T04:38:04.631764+0000","last_undegraded":"2024-09-17T04:38:04.631764+0000","last_fullsized":"2024-09-17T04:38:04.631764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:17.056823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647472+0000","last_change":"2024-09-17T04:34:51.077199+0000","last_active":"2024-09-17T04:39:41.647472+0000","last_peered":"2024-09-17T04:39:41.647472+0000","last_clean":"2024-09-17T04:39:41.647472+0000","last_became_active":"2024-09-17T04:34:51.076867+0000","last_became_peered":"2024-09-17T04:34:51.076867+0000","last_unstale":"2024-09-17T04:39:41.647472+0000","last_undegraded":"2024-09-17T04:39:41.647472+0000","last_fullsized":"2024-09-17T04:39:41.647472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:09.194133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644651+0000","last_change":"2024-09-17T04:34:52.083401+0000","last_active":"2024-09-17T04:39:44.644651+0000","last_peered":"2024-09-17T04:39:44.644651+0000","last_clean":"2024-09-17T04:39:44.644651+0000","last_became_active":"2024-09-17T04:34:52.083086+0000","last_became_peered":"2024-09-17T04:34:52.083086+0000","last_unstale":"2024-09-17T04:39:44.644651+0000","last_undegraded":"2024-09-17T04:39:44.644651+0000","last_fullsized":"2024-09-17T04:39:44.644651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.237945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'7","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644384+0000","last_change":"2024-09-17T04:34:51.070235+0000","last_active":"2024-09-17T04:39:44.644384+0000","last_peered":"2024-09-17T04:39:44.644384+0000","last_clean":"2024-09-17T04:39:44.644384+0000","last_became_active":"2024-09-17T04:34:51.069278+0000","last_became_peered":"2024-09-17T04:34:51.069278+0000","last_unstale":"2024-09-17T04:39:44.644384+0000","last_undegraded":"2024-09-17T04:39:44.644384+0000","last_fullsized":"2024-09-17T04:39:44.644384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:55.959278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.645807+0000","last_change":"2024-09-17T04:34:52.076233+0000","last_active":"2024-09-17T04:39:31.645807+0000","last_peered":"2024-09-17T04:39:31.645807+0000","last_clean":"2024-09-17T04:39:31.645807+0000","last_became_active":"2024-09-17T04:34:52.075682+0000","last_became_peered":"2024-09-17T04:34:52.075682+0000","last_unstale":"2024-09-17T04:39:31.645807+0000","last_undegraded":"2024-09-17T04:39:31.645807+0000","last_fullsized":"2024-09-17T04:39:31.645807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:22.047574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'25","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.645795+0000","last_change":"2024-09-17T04:34:51.076416+0000","last_active":"2024-09-17T04:39:31.645795+0000","last_peered":"2024-09-17T04:39:31.645795+0000","last_clean":"2024-09-17T04:39:31.645795+0000","last_became_active":"2024-09-17T04:34:51.076051+0000","last_became_peered":"2024-09-17T04:34:51.076051+0000","last_unstale":"2024-09-17T04:39:31.645795+0000","last_undegraded":"2024-09-17T04:39:31.645795+0000","last_fullsized":"2024-09-17T04:39:31.645795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:52.255204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37038,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647683+0000","last_change":"2024-09-17T04:34:52.086230+0000","last_active":"2024-09-17T04:39:41.647683+0000","last_peered":"2024-09-17T04:39:41.647683+0000","last_clean":"2024-09-17T04:39:41.647683+0000","last_became_active":"2024-09-17T04:34:52.085910+0000","last_became_peered":"2024-09-17T04:34:52.085910+0000","last_unstale":"2024-09-17T04:39:41.647683+0000","last_undegraded":"2024-09-17T04:39:41.647683+0000","last_fullsized":"2024-09-17T04:39:41.647683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:36.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.643405+0000","last_change":"2024-09-17T04:34:51.075224+0000","last_active":"2024-09-17T04:39:34.643405+0000","last_peered":"2024-09-17T04:39:34.643405+0000","last_clean":"2024-09-17T04:39:34.643405+0000","last_became_active":"2024-09-17T04:34:51.074912+0000","last_became_peered":"2024-09-17T04:34:51.074912+0000","last_unstale":"2024-09-17T04:39:34.643405+0000","last_undegraded":"2024-09-17T04:39:34.643405+0000","last_fullsized":"2024-09-17T04:39:34.643405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:33.811243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.643389+0000","last_change":"2024-09-17T04:34:52.085906+0000","last_active":"2024-09-17T04:39:34.643389+0000","last_peered":"2024-09-17T04:39:34.643389+0000","last_clean":"2024-09-17T04:39:34.643389+0000","last_became_active":"2024-09-17T04:34:52.085538+0000","last_became_peered":"2024-09-17T04:34:52.085538+0000","last_unstale":"2024-09-17T04:39:34.643389+0000","last_undegraded":"2024-09-17T04:39:34.643389+0000","last_fullsized":"2024-09-17T04:39:34.643389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:21.997395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.646079+0000","last_change":"2024-09-17T04:34:51.074253+0000","last_active":"2024-09-17T04:39:31.646079+0000","last_peered":"2024-09-17T04:39:31.646079+0000","last_clean":"2024-09-17T04:39:31.646079+0000","last_became_active":"2024-09-17T04:34:51.073812+0000","last_became_peered":"2024-09-17T04:34:51.073812+0000","last_unstale":"2024-09-17T04:39:31.646079+0000","last_undegraded":"2024-09-17T04:39:31.646079+0000","last_fullsized":"2024-09-17T04:39:31.646079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:38.971561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.646447+0000","last_change":"2024-09-17T04:34:52.082137+0000","last_active":"2024-09-17T04:39:31.646447+0000","last_peered":"2024-09-17T04:39:31.646447+0000","last_clean":"2024-09-17T04:39:31.646447+0000","last_became_active":"2024-09-17T04:34:52.081775+0000","last_became_peered":"2024-09-17T04:34:52.081775+0000","last_unstale":"2024-09-17T04:39:31.646447+0000","last_undegraded":"2024-09-17T04:39:31.646447+0000","last_fullsized":"2024-09-17T04:39:31.646447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:57.911822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.645765+0000","last_change":"2024-09-17T04:34:51.077157+0000","last_active":"2024-09-17T04:39:31.645765+0000","last_peered":"2024-09-17T04:39:31.645765+0000","last_clean":"2024-09-17T04:39:31.645765+0000","last_became_active":"2024-09-17T04:34:51.076797+0000","last_became_peered":"2024-09-17T04:34:51.076797+0000","last_unstale":"2024-09-17T04:39:31.645765+0000","last_undegraded":"2024-09-17T04:39:31.645765+0000","last_fullsized":"2024-09-17T04:39:31.645765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:20.118978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":844,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.645738+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:39:31.645738+0000","last_peered":"2024-09-17T04:39:31.645738+0000","last_clean":"2024-09-17T04:39:31.645738+0000","last_became_active":"2024-09-17T04:34:52.082118+0000","last_became_peered":"2024-09-17T04:34:52.082118+0000","last_unstale":"2024-09-17T04:39:31.645738+0000","last_undegraded":"2024-09-17T04:39:31.645738+0000","last_fullsized":"2024-09-17T04:39:31.645738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:44.752945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'16","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.642945+0000","last_change":"2024-09-17T04:34:51.071083+0000","last_active":"2024-09-17T04:39:34.642945+0000","last_peered":"2024-09-17T04:39:34.642945+0000","last_clean":"2024-09-17T04:39:34.642945+0000","last_became_active":"2024-09-17T04:34:51.070733+0000","last_became_peered":"2024-09-17T04:34:51.070733+0000","last_unstale":"2024-09-17T04:39:34.642945+0000","last_undegraded":"2024-09-17T04:39:34.642945+0000","last_fullsized":"2024-09-17T04:39:34.642945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:36.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.646422+0000","last_change":"2024-09-17T04:34:52.080277+0000","last_active":"2024-09-17T04:39:31.646422+0000","last_peered":"2024-09-17T04:39:31.646422+0000","last_clean":"2024-09-17T04:39:31.646422+0000","last_became_active":"2024-09-17T04:34:52.079969+0000","last_became_peered":"2024-09-17T04:34:52.079969+0000","last_unstale":"2024-09-17T04:39:31.646422+0000","last_undegraded":"2024-09-17T04:39:31.646422+0000","last_fullsized":"2024-09-17T04:39:31.646422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:10.360905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.644561+0000","last_change":"2024-09-17T04:34:51.074800+0000","last_active":"2024-09-17T04:39:21.644561+0000","last_peered":"2024-09-17T04:39:21.644561+0000","last_clean":"2024-09-17T04:39:21.644561+0000","last_became_active":"2024-09-17T04:34:51.073287+0000","last_became_peered":"2024-09-17T04:34:51.073287+0000","last_unstale":"2024-09-17T04:39:21.644561+0000","last_undegraded":"2024-09-17T04:39:21.644561+0000","last_fullsized":"2024-09-17T04:39:21.644561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:19.933857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.645232+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:39:21.645232+0000","last_peered":"2024-09-17T04:39:21.645232+0000","last_clean":"2024-09-17T04:39:21.645232+0000","last_became_active":"2024-09-17T04:34:52.082607+0000","last_became_peered":"2024-09-17T04:34:52.082607+0000","last_unstale":"2024-09-17T04:39:21.645232+0000","last_undegraded":"2024-09-17T04:39:21.645232+0000","last_fullsized":"2024-09-17T04:39:21.645232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:08.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.641560+0000","last_change":"2024-09-17T04:34:51.077171+0000","last_active":"2024-09-17T04:39:24.641560+0000","last_peered":"2024-09-17T04:39:24.641560+0000","last_clean":"2024-09-17T04:39:24.641560+0000","last_became_active":"2024-09-17T04:34:51.076780+0000","last_became_peered":"2024-09-17T04:34:51.076780+0000","last_unstale":"2024-09-17T04:39:24.641560+0000","last_undegraded":"2024-09-17T04:39:24.641560+0000","last_fullsized":"2024-09-17T04:39:24.641560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:40.031852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.645255+0000","last_change":"2024-09-17T04:34:52.080032+0000","last_active":"2024-09-17T04:39:21.645255+0000","last_peered":"2024-09-17T04:39:21.645255+0000","last_clean":"2024-09-17T04:39:21.645255+0000","last_became_active":"2024-09-17T04:34:52.079536+0000","last_became_peered":"2024-09-17T04:34:52.079536+0000","last_unstale":"2024-09-17T04:39:21.645255+0000","last_undegraded":"2024-09-17T04:39:21.645255+0000","last_fullsized":"2024-09-17T04:39:21.645255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:55.220027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.641570+0000","last_change":"2024-09-17T04:34:51.071053+0000","last_active":"2024-09-17T04:39:24.641570+0000","last_peered":"2024-09-17T04:39:24.641570+0000","last_clean":"2024-09-17T04:39:24.641570+0000","last_became_active":"2024-09-17T04:34:51.070673+0000","last_became_peered":"2024-09-17T04:34:51.070673+0000","last_unstale":"2024-09-17T04:39:24.641570+0000","last_undegraded":"2024-09-17T04:39:24.641570+0000","last_fullsized":"2024-09-17T04:39:24.641570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:31.660200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.644973+0000","last_change":"2024-09-17T04:34:52.077963+0000","last_active":"2024-09-17T04:39:21.644973+0000","last_peered":"2024-09-17T04:39:21.644973+0000","last_clean":"2024-09-17T04:39:21.644973+0000","last_became_active":"2024-09-17T04:34:52.077499+0000","last_became_peered":"2024-09-17T04:34:52.077499+0000","last_unstale":"2024-09-17T04:39:21.644973+0000","last_undegraded":"2024-09-17T04:39:21.644973+0000","last_fullsized":"2024-09-17T04:39:21.644973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:25.309696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.641526+0000","last_change":"2024-09-17T04:34:51.070532+0000","last_active":"2024-09-17T04:39:24.641526+0000","last_peered":"2024-09-17T04:39:24.641526+0000","last_clean":"2024-09-17T04:39:24.641526+0000","last_became_active":"2024-09-17T04:34:51.070179+0000","last_became_peered":"2024-09-17T04:34:51.070179+0000","last_unstale":"2024-09-17T04:39:24.641526+0000","last_undegraded":"2024-09-17T04:39:24.641526+0000","last_fullsized":"2024-09-17T04:39:24.641526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:52.027096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.645192+0000","last_change":"2024-09-17T04:34:52.083159+0000","last_active":"2024-09-17T04:39:21.645192+0000","last_peered":"2024-09-17T04:39:21.645192+0000","last_clean":"2024-09-17T04:39:21.645192+0000","last_became_active":"2024-09-17T04:34:52.082847+0000","last_became_peered":"2024-09-17T04:34:52.082847+0000","last_unstale":"2024-09-17T04:39:21.645192+0000","last_undegraded":"2024-09-17T04:39:21.645192+0000","last_fullsized":"2024-09-17T04:39:21.645192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:25.210506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:41.640327+0000","last_change":"2024-09-17T04:34:41.975789+0000","last_active":"2024-09-17T04:38:41.640327+0000","last_peered":"2024-09-17T04:38:41.640327+0000","last_clean":"2024-09-17T04:38:41.640327+0000","last_became_active":"2024-09-17T04:34:41.974664+0000","last_became_peered":"2024-09-17T04:34:41.974664+0000","last_unstale":"2024-09-17T04:38:41.640327+0000","last_undegraded":"2024-09-17T04:38:41.640327+0000","last_fullsized":"2024-09-17T04:38:41.640327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_clean_scrub_stamp":"2024-09-17T04:34:39.702713+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:30.302931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642564+0000","last_change":"2024-09-17T04:34:51.068782+0000","last_active":"2024-09-17T04:39:01.642564+0000","last_peered":"2024-09-17T04:39:01.642564+0000","last_clean":"2024-09-17T04:39:01.642564+0000","last_became_active":"2024-09-17T04:34:51.068375+0000","last_became_peered":"2024-09-17T04:34:51.068375+0000","last_unstale":"2024-09-17T04:39:01.642564+0000","last_undegraded":"2024-09-17T04:39:01.642564+0000","last_fullsized":"2024-09-17T04:39:01.642564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:25.307166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:49.644929+0000","last_change":"2024-09-17T04:35:37.196118+0000","last_active":"2024-09-17T04:39:49.644929+0000","last_peered":"2024-09-17T04:39:49.644929+0000","last_clean":"2024-09-17T04:39:49.644929+0000","last_became_active":"2024-09-17T04:35:37.195780+0000","last_became_peered":"2024-09-17T04:35:37.195780+0000","last_unstale":"2024-09-17T04:39:49.644929+0000","last_undegraded":"2024-09-17T04:39:49.644929+0000","last_fullsized":"2024-09-17T04:39:49.644929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:48.569400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:51.641567+0000","last_change":"2024-09-17T04:34:51.075655+0000","last_active":"2024-09-17T04:38:51.641567+0000","last_peered":"2024-09-17T04:38:51.641567+0000","last_clean":"2024-09-17T04:38:51.641567+0000","last_became_active":"2024-09-17T04:34:51.075313+0000","last_became_peered":"2024-09-17T04:34:51.075313+0000","last_unstale":"2024-09-17T04:38:51.641567+0000","last_undegraded":"2024-09-17T04:38:51.641567+0000","last_fullsized":"2024-09-17T04:38:51.641567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:47.853850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.640022+0000","last_change":"2024-09-17T04:34:52.080065+0000","last_active":"2024-09-17T04:39:04.640022+0000","last_peered":"2024-09-17T04:39:04.640022+0000","last_clean":"2024-09-17T04:39:04.640022+0000","last_became_active":"2024-09-17T04:34:52.079672+0000","last_became_peered":"2024-09-17T04:34:52.079672+0000","last_unstale":"2024-09-17T04:39:04.640022+0000","last_undegraded":"2024-09-17T04:39:04.640022+0000","last_fullsized":"2024-09-17T04:39:04.640022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:52.040153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"24'8","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.639201+0000","last_change":"2024-09-17T04:34:51.075960+0000","last_active":"2024-09-17T04:39:04.639201+0000","last_peered":"2024-09-17T04:39:04.639201+0000","last_clean":"2024-09-17T04:39:04.639201+0000","last_became_active":"2024-09-17T04:34:51.075561+0000","last_became_peered":"2024-09-17T04:34:51.075561+0000","last_unstale":"2024-09-17T04:39:04.639201+0000","last_undegraded":"2024-09-17T04:39:04.639201+0000","last_fullsized":"2024-09-17T04:39:04.639201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:44.834618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:54.637775+0000","last_change":"2024-09-17T04:34:52.070068+0000","last_active":"2024-09-17T04:38:54.637775+0000","last_peered":"2024-09-17T04:38:54.637775+0000","last_clean":"2024-09-17T04:38:54.637775+0000","last_became_active":"2024-09-17T04:34:52.069669+0000","last_became_peered":"2024-09-17T04:34:52.069669+0000","last_unstale":"2024-09-17T04:38:54.637775+0000","last_undegraded":"2024-09-17T04:38:54.637775+0000","last_fullsized":"2024-09-17T04:38:54.637775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:39.617045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642537+0000","last_change":"2024-09-17T04:34:51.070187+0000","last_active":"2024-09-17T04:39:01.642537+0000","last_peered":"2024-09-17T04:39:01.642537+0000","last_clean":"2024-09-17T04:39:01.642537+0000","last_became_active":"2024-09-17T04:34:51.069714+0000","last_became_peered":"2024-09-17T04:34:51.069714+0000","last_unstale":"2024-09-17T04:39:01.642537+0000","last_undegraded":"2024-09-17T04:39:01.642537+0000","last_fullsized":"2024-09-17T04:39:01.642537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:28.082690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642121+0000","last_change":"2024-09-17T04:34:52.069653+0000","last_active":"2024-09-17T04:39:01.642121+0000","last_peered":"2024-09-17T04:39:01.642121+0000","last_clean":"2024-09-17T04:39:01.642121+0000","last_became_active":"2024-09-17T04:34:52.069282+0000","last_became_peered":"2024-09-17T04:34:52.069282+0000","last_unstale":"2024-09-17T04:39:01.642121+0000","last_undegraded":"2024-09-17T04:39:01.642121+0000","last_fullsized":"2024-09-17T04:39:01.642121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:40.828725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.639231+0000","last_change":"2024-09-17T04:34:51.070676+0000","last_active":"2024-09-17T04:39:04.639231+0000","last_peered":"2024-09-17T04:39:04.639231+0000","last_clean":"2024-09-17T04:39:04.639231+0000","last_became_active":"2024-09-17T04:34:51.069006+0000","last_became_peered":"2024-09-17T04:34:51.069006+0000","last_unstale":"2024-09-17T04:39:04.639231+0000","last_undegraded":"2024-09-17T04:39:04.639231+0000","last_fullsized":"2024-09-17T04:39:04.639231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:45.452865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642599+0000","last_change":"2024-09-17T04:34:52.087131+0000","last_active":"2024-09-17T04:39:01.642599+0000","last_peered":"2024-09-17T04:39:01.642599+0000","last_clean":"2024-09-17T04:39:01.642599+0000","last_became_active":"2024-09-17T04:34:52.086782+0000","last_became_peered":"2024-09-17T04:34:52.086782+0000","last_unstale":"2024-09-17T04:39:01.642599+0000","last_undegraded":"2024-09-17T04:39:01.642599+0000","last_fullsized":"2024-09-17T04:39:01.642599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:53.987579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642786+0000","last_change":"2024-09-17T04:34:51.068708+0000","last_active":"2024-09-17T04:39:01.642786+0000","last_peered":"2024-09-17T04:39:01.642786+0000","last_clean":"2024-09-17T04:39:01.642786+0000","last_became_active":"2024-09-17T04:34:51.068354+0000","last_became_peered":"2024-09-17T04:34:51.068354+0000","last_unstale":"2024-09-17T04:39:01.642786+0000","last_undegraded":"2024-09-17T04:39:01.642786+0000","last_fullsized":"2024-09-17T04:39:01.642786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:04.219898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.639204+0000","last_change":"2024-09-17T04:34:52.071586+0000","last_active":"2024-09-17T04:39:04.639204+0000","last_peered":"2024-09-17T04:39:04.639204+0000","last_clean":"2024-09-17T04:39:04.639204+0000","last_became_active":"2024-09-17T04:34:52.071246+0000","last_became_peered":"2024-09-17T04:34:52.071246+0000","last_unstale":"2024-09-17T04:39:04.639204+0000","last_undegraded":"2024-09-17T04:39:04.639204+0000","last_fullsized":"2024-09-17T04:39:04.639204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:03.620107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'12","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640449+0000","last_change":"2024-09-17T04:34:51.078947+0000","last_active":"2024-09-17T04:39:14.640449+0000","last_peered":"2024-09-17T04:39:14.640449+0000","last_clean":"2024-09-17T04:39:14.640449+0000","last_became_active":"2024-09-17T04:34:51.078557+0000","last_became_peered":"2024-09-17T04:34:51.078557+0000","last_unstale":"2024-09-17T04:39:14.640449+0000","last_undegraded":"2024-09-17T04:39:14.640449+0000","last_fullsized":"2024-09-17T04:39:14.640449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:51.413772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640903+0000","last_change":"2024-09-17T04:34:52.086372+0000","last_active":"2024-09-17T04:39:14.640903+0000","last_peered":"2024-09-17T04:39:14.640903+0000","last_clean":"2024-09-17T04:39:14.640903+0000","last_became_active":"2024-09-17T04:34:52.086018+0000","last_became_peered":"2024-09-17T04:34:52.086018+0000","last_unstale":"2024-09-17T04:39:14.640903+0000","last_undegraded":"2024-09-17T04:39:14.640903+0000","last_fullsized":"2024-09-17T04:39:14.640903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:10.818503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:11.643392+0000","last_change":"2024-09-17T04:34:51.076427+0000","last_active":"2024-09-17T04:39:11.643392+0000","last_peered":"2024-09-17T04:39:11.643392+0000","last_clean":"2024-09-17T04:39:11.643392+0000","last_became_active":"2024-09-17T04:34:51.075881+0000","last_became_peered":"2024-09-17T04:34:51.075881+0000","last_unstale":"2024-09-17T04:39:11.643392+0000","last_undegraded":"2024-09-17T04:39:11.643392+0000","last_fullsized":"2024-09-17T04:39:11.643392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:40.903989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.641054+0000","last_change":"2024-09-17T04:34:52.076358+0000","last_active":"2024-09-17T04:39:14.641054+0000","last_peered":"2024-09-17T04:39:14.641054+0000","last_clean":"2024-09-17T04:39:14.641054+0000","last_became_active":"2024-09-17T04:34:52.076035+0000","last_became_peered":"2024-09-17T04:34:52.076035+0000","last_unstale":"2024-09-17T04:39:14.641054+0000","last_undegraded":"2024-09-17T04:39:14.641054+0000","last_fullsized":"2024-09-17T04:39:14.641054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:30.660617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:11.644007+0000","last_change":"2024-09-17T04:34:51.072737+0000","last_active":"2024-09-17T04:39:11.644007+0000","last_peered":"2024-09-17T04:39:11.644007+0000","last_clean":"2024-09-17T04:39:11.644007+0000","last_became_active":"2024-09-17T04:34:51.072378+0000","last_became_peered":"2024-09-17T04:34:51.072378+0000","last_unstale":"2024-09-17T04:39:11.644007+0000","last_undegraded":"2024-09-17T04:39:11.644007+0000","last_fullsized":"2024-09-17T04:39:11.644007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:27.364636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:11.643314+0000","last_change":"2024-09-17T04:34:52.068446+0000","last_active":"2024-09-17T04:39:11.643314+0000","last_peered":"2024-09-17T04:39:11.643314+0000","last_clean":"2024-09-17T04:39:11.643314+0000","last_became_active":"2024-09-17T04:34:52.068047+0000","last_became_peered":"2024-09-17T04:34:52.068047+0000","last_unstale":"2024-09-17T04:39:11.643314+0000","last_undegraded":"2024-09-17T04:39:11.643314+0000","last_fullsized":"2024-09-17T04:39:11.643314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:26.994189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640372+0000","last_change":"2024-09-17T04:34:51.069539+0000","last_active":"2024-09-17T04:39:14.640372+0000","last_peered":"2024-09-17T04:39:14.640372+0000","last_clean":"2024-09-17T04:39:14.640372+0000","last_became_active":"2024-09-17T04:34:51.067438+0000","last_became_peered":"2024-09-17T04:34:51.067438+0000","last_unstale":"2024-09-17T04:39:14.640372+0000","last_undegraded":"2024-09-17T04:39:14.640372+0000","last_fullsized":"2024-09-17T04:39:14.640372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:13.078391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640844+0000","last_change":"2024-09-17T04:34:52.078035+0000","last_active":"2024-09-17T04:39:14.640844+0000","last_peered":"2024-09-17T04:39:14.640844+0000","last_clean":"2024-09-17T04:39:14.640844+0000","last_became_active":"2024-09-17T04:34:52.077708+0000","last_became_peered":"2024-09-17T04:34:52.077708+0000","last_unstale":"2024-09-17T04:39:14.640844+0000","last_undegraded":"2024-09-17T04:39:14.640844+0000","last_fullsized":"2024-09-17T04:39:14.640844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:00.313209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640414+0000","last_change":"2024-09-17T04:34:51.074749+0000","last_active":"2024-09-17T04:39:14.640414+0000","last_peered":"2024-09-17T04:39:14.640414+0000","last_clean":"2024-09-17T04:39:14.640414+0000","last_became_active":"2024-09-17T04:34:51.074393+0000","last_became_peered":"2024-09-17T04:34:51.074393+0000","last_unstale":"2024-09-17T04:39:14.640414+0000","last_undegraded":"2024-09-17T04:39:14.640414+0000","last_fullsized":"2024-09-17T04:39:14.640414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:39.558815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.641915+0000","last_change":"2024-09-17T04:34:52.075585+0000","last_active":"2024-09-17T04:39:24.641915+0000","last_peered":"2024-09-17T04:39:24.641915+0000","last_clean":"2024-09-17T04:39:24.641915+0000","last_became_active":"2024-09-17T04:34:52.075257+0000","last_became_peered":"2024-09-17T04:34:52.075257+0000","last_unstale":"2024-09-17T04:39:24.641915+0000","last_undegraded":"2024-09-17T04:39:24.641915+0000","last_fullsized":"2024-09-17T04:39:24.641915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:38.029256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.645156+0000","last_change":"2024-09-17T04:34:51.071324+0000","last_active":"2024-09-17T04:39:21.645156+0000","last_peered":"2024-09-17T04:39:21.645156+0000","last_clean":"2024-09-17T04:39:21.645156+0000","last_became_active":"2024-09-17T04:34:51.070944+0000","last_became_peered":"2024-09-17T04:34:51.070944+0000","last_unstale":"2024-09-17T04:39:21.645156+0000","last_undegraded":"2024-09-17T04:39:21.645156+0000","last_fullsized":"2024-09-17T04:39:21.645156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:13.931324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:11.643319+0000","last_change":"2024-09-17T04:34:52.081178+0000","last_active":"2024-09-17T04:39:11.643319+0000","last_peered":"2024-09-17T04:39:11.643319+0000","last_clean":"2024-09-17T04:39:11.643319+0000","last_became_active":"2024-09-17T04:34:52.080855+0000","last_became_peered":"2024-09-17T04:34:52.080855+0000","last_unstale":"2024-09-17T04:39:11.643319+0000","last_undegraded":"2024-09-17T04:39:11.643319+0000","last_fullsized":"2024-09-17T04:39:11.643319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:49.091080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.648795+0000","last_change":"2024-09-17T04:34:52.066633+0000","last_active":"2024-09-17T04:39:51.648795+0000","last_peered":"2024-09-17T04:39:51.648795+0000","last_clean":"2024-09-17T04:39:51.648795+0000","last_became_active":"2024-09-17T04:34:52.066263+0000","last_became_peered":"2024-09-17T04:34:52.066263+0000","last_unstale":"2024-09-17T04:39:51.648795+0000","last_undegraded":"2024-09-17T04:39:51.648795+0000","last_fullsized":"2024-09-17T04:39:51.648795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:13.396220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.649018+0000","last_change":"2024-09-17T04:34:51.067927+0000","last_active":"2024-09-17T04:39:51.649018+0000","last_peered":"2024-09-17T04:39:51.649018+0000","last_clean":"2024-09-17T04:39:51.649018+0000","last_became_active":"2024-09-17T04:34:51.067555+0000","last_became_peered":"2024-09-17T04:34:51.067555+0000","last_unstale":"2024-09-17T04:39:51.649018+0000","last_undegraded":"2024-09-17T04:39:51.649018+0000","last_fullsized":"2024-09-17T04:39:51.649018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:33.815585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.648774+0000","last_change":"2024-09-17T04:34:52.074529+0000","last_active":"2024-09-17T04:39:51.648774+0000","last_peered":"2024-09-17T04:39:51.648774+0000","last_clean":"2024-09-17T04:39:51.648774+0000","last_became_active":"2024-09-17T04:34:52.074149+0000","last_became_peered":"2024-09-17T04:34:52.074149+0000","last_unstale":"2024-09-17T04:39:51.648774+0000","last_undegraded":"2024-09-17T04:39:51.648774+0000","last_fullsized":"2024-09-17T04:39:51.648774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:31.679908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.649033+0000","last_change":"2024-09-17T04:34:51.078231+0000","last_active":"2024-09-17T04:39:51.649033+0000","last_peered":"2024-09-17T04:39:51.649033+0000","last_clean":"2024-09-17T04:39:51.649033+0000","last_became_active":"2024-09-17T04:34:51.077872+0000","last_became_peered":"2024-09-17T04:34:51.077872+0000","last_unstale":"2024-09-17T04:39:51.649033+0000","last_undegraded":"2024-09-17T04:39:51.649033+0000","last_fullsized":"2024-09-17T04:39:51.649033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:38.304333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:49.644999+0000","last_change":"2024-09-17T04:35:37.198244+0000","last_active":"2024-09-17T04:39:49.644999+0000","last_peered":"2024-09-17T04:39:49.644999+0000","last_clean":"2024-09-17T04:39:49.644999+0000","last_became_active":"2024-09-17T04:35:37.197990+0000","last_became_peered":"2024-09-17T04:35:37.197990+0000","last_unstale":"2024-09-17T04:39:49.644999+0000","last_undegraded":"2024-09-17T04:39:49.644999+0000","last_fullsized":"2024-09-17T04:39:49.644999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:47:41.801990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:54.638937+0000","last_change":"2024-09-17T04:34:51.073959+0000","last_active":"2024-09-17T04:38:54.638937+0000","last_peered":"2024-09-17T04:38:54.638937+0000","last_clean":"2024-09-17T04:38:54.638937+0000","last_became_active":"2024-09-17T04:34:51.073496+0000","last_became_peered":"2024-09-17T04:34:51.073496+0000","last_unstale":"2024-09-17T04:38:54.638937+0000","last_undegraded":"2024-09-17T04:38:54.638937+0000","last_fullsized":"2024-09-17T04:38:54.638937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:23.001571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:54.638910+0000","last_change":"2024-09-17T04:34:52.081971+0000","last_active":"2024-09-17T04:38:54.638910+0000","last_peered":"2024-09-17T04:38:54.638910+0000","last_clean":"2024-09-17T04:38:54.638910+0000","last_became_active":"2024-09-17T04:34:52.081259+0000","last_became_peered":"2024-09-17T04:34:52.081259+0000","last_unstale":"2024-09-17T04:38:54.638910+0000","last_undegraded":"2024-09-17T04:38:54.638910+0000","last_fullsized":"2024-09-17T04:38:54.638910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:43.915741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.640080+0000","last_change":"2024-09-17T04:34:51.070142+0000","last_active":"2024-09-17T04:39:04.640080+0000","last_peered":"2024-09-17T04:39:04.640080+0000","last_clean":"2024-09-17T04:39:04.640080+0000","last_became_active":"2024-09-17T04:34:51.069777+0000","last_became_peered":"2024-09-17T04:34:51.069777+0000","last_unstale":"2024-09-17T04:39:04.640080+0000","last_undegraded":"2024-09-17T04:39:04.640080+0000","last_fullsized":"2024-09-17T04:39:04.640080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:51.718064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":41308,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":169,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":82616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476833,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":680436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476833,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":126724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476833,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":90130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476833,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":258048,"data_stored":89722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542241,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35640,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336200,"statfs":{"total":96636764160,"available":96600268800,"internally_reserved":0,"allocated":303104,"data_stored":126906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542241,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":89974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542242,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":89696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542242,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":679780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":38154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":37972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:42:32.450 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:42:32.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.603+0000 7f9dd06bd640 1 -- 172.21.15.43:0/3482532885 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc80c6990 msgr2=0x7f9dc80c6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:32.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.603+0000 7f9dd06bd640 1 --2- 172.21.15.43:0/3482532885 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc80c6990 0x7f9dc80c6da0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0005fd0 tx=0x7f9dc002aa10 comp rx=0 tx=0).stop 2024-09-17T04:42:32.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.603+0000 7f9dd06bd640 1 -- 172.21.15.43:0/3482532885 shutdown_connections 2024-09-17T04:42:32.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.603+0000 7f9dd06bd640 1 --2- 172.21.15.43:0/3482532885 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc80c6990 0x7f9dc80c6da0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.603+0000 7f9dd06bd640 1 --2- 172.21.15.43:0/3482532885 >> v2:172.21.15.43:3300/0 conn(0x7f9dc80c9850 0x7f9dc8159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.603+0000 7f9dd06bd640 1 -- 172.21.15.43:0/3482532885 >> 172.21.15.43:0/3482532885 conn(0x7f9dc806edc0 msgr2=0x7f9dc806cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:42:32.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.603+0000 7f9dd06bd640 1 -- 172.21.15.43:0/3482532885 shutdown_connections 2024-09-17T04:42:32.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.603+0000 7f9dd06bd640 1 -- 172.21.15.43:0/3482532885 wait complete. 2024-09-17T04:42:32.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.605+0000 7f9dd06bd640 1 Processor -- start 2024-09-17T04:42:32.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.605+0000 7f9dd06bd640 1 -- start start 2024-09-17T04:42:32.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.606+0000 7f9dd06bd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc80c6990 0x7f9dc814ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:32.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.606+0000 7f9dd06bd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9dc80c9850 0x7f9dc80cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:32.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.606+0000 7f9dd06bd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc80ca7a0 0x7f9dc80cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:32.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.606+0000 7f9dd06bd640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc8153d80 con 0x7f9dc80c9850 2024-09-17T04:42:32.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.606+0000 7f9dd06bd640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc80c7e20 con 0x7f9dc80ca7a0 2024-09-17T04:42:32.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.606+0000 7f9dd06bd640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc806da50 con 0x7f9dc80c6990 2024-09-17T04:42:32.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.606+0000 7f9dcdc58640 1 -- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9dc80c9850 msgr2=0x7f9dc80cc4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:3300/0 2024-09-17T04:42:32.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.606+0000 7f9dcdc58640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9dc80c9850 0x7f9dc80cc4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:42:32.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.606+0000 7f9dce459640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc80c6990 0x7f9dc814ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:42:32.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.606+0000 7f9dcec5a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc80ca7a0 0x7f9dc80cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:42:32.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.606+0000 7f9dce459640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc80c6990 0x7f9dc814ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:58274/0 (socket says 172.21.15.43:58274) 2024-09-17T04:42:32.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.606+0000 7f9dcec5a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc80ca7a0 0x7f9dc80cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:39636/0 (socket says 172.21.15.43:39636) 2024-09-17T04:42:32.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.606+0000 7f9dce459640 1 -- 172.21.15.43:0/586149511 learned_addr learned my addr 172.21.15.43:0/586149511 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:42:32.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.607+0000 7f9dcec5a640 1 -- 172.21.15.43:0/586149511 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc80c6990 msgr2=0x7f9dc814ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:32.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.607+0000 7f9dcec5a640 1 --2- 172.21.15.43:0/586149511 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc80c6990 0x7f9dc814ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.607+0000 7f9dcec5a640 1 -- 172.21.15.43:0/586149511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9dc80c9850 msgr2=0x7f9dc80cc4f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:42:32.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.607+0000 7f9dcec5a640 1 --2- 172.21.15.43:0/586149511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9dc80c9850 0x7f9dc80cc4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.607+0000 7f9dcec5a640 1 -- 172.21.15.43:0/586149511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc814c5b0 con 0x7f9dc80ca7a0 2024-09-17T04:42:32.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.607+0000 7f9dce459640 1 --2- 172.21.15.43:0/586149511 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc80c6990 0x7f9dc814ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:42:32.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.607+0000 7f9dcec5a640 1 --2- 172.21.15.43:0/586149511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc80ca7a0 0x7f9dc80cca30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0032000 tx=0x7f9dc0003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:42:32.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.607+0000 7f9dbeffd640 1 -- 172.21.15.43:0/586149511 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0033050 con 0x7f9dc80ca7a0 2024-09-17T04:42:32.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.607+0000 7f9dbeffd640 1 -- 172.21.15.43:0/586149511 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9dc003caf0 con 0x7f9dc80ca7a0 2024-09-17T04:42:32.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.607+0000 7f9dd06bd640 1 -- 172.21.15.43:0/586149511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc8156b20 con 0x7f9dc80ca7a0 2024-09-17T04:42:32.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.607+0000 7f9dbeffd640 1 -- 172.21.15.43:0/586149511 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0004040 con 0x7f9dc80ca7a0 2024-09-17T04:42:32.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.607+0000 7f9dd06bd640 1 -- 172.21.15.43:0/586149511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc81f0740 con 0x7f9dc80ca7a0 2024-09-17T04:42:32.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.608+0000 7f9dd06bd640 1 -- 172.21.15.43:0/586149511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc80ca230 con 0x7f9dc80ca7a0 2024-09-17T04:42:32.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.609+0000 7f9dbeffd640 1 -- 172.21.15.43:0/586149511 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9dc0036070 con 0x7f9dc80ca7a0 2024-09-17T04:42:32.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.610+0000 7f9dbeffd640 1 --2- 172.21.15.43:0/586149511 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9dac078b40 0x7f9dac07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:32.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.610+0000 7f9dbeffd640 1 -- 172.21.15.43:0/586149511 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5833+0+0 (secure 0 0 0) 0x7f9dc00c0470 con 0x7f9dc80ca7a0 2024-09-17T04:42:32.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.610+0000 7f9dce459640 1 --2- 172.21.15.43:0/586149511 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9dac078b40 0x7f9dac07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:42:32.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.610+0000 7f9dce459640 1 --2- 172.21.15.43:0/586149511 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9dac078b40 0x7f9dac07b050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009f70 tx=0x7f9dc4009a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:42:32.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.614+0000 7f9dbeffd640 1 -- 172.21.15.43:0/586149511 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9dc00888c0 con 0x7f9dc80ca7a0 2024-09-17T04:42:32.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.795+0000 7f9dd06bd640 1 -- 172.21.15.43:0/586149511 --> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9dc81539f0 con 0x7f9dac078b40 2024-09-17T04:42:32.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.800+0000 7f9dbeffd640 1 -- 172.21.15.43:0/586149511 <== mgr.4100 v2:172.21.15.62:6800/1186143747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251891 (secure 0 0 0) 0x7f9dc81539f0 con 0x7f9dac078b40 2024-09-17T04:42:32.803 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:42:32.804 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-17T04:42:32.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.803+0000 7f9dd06bd640 1 -- 172.21.15.43:0/586149511 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9dac078b40 msgr2=0x7f9dac07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:32.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.803+0000 7f9dd06bd640 1 --2- 172.21.15.43:0/586149511 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9dac078b40 0x7f9dac07b050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009f70 tx=0x7f9dc4009a30 comp rx=0 tx=0).stop 2024-09-17T04:42:32.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.803+0000 7f9dd06bd640 1 -- 172.21.15.43:0/586149511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc80ca7a0 msgr2=0x7f9dc80cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:32.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.803+0000 7f9dd06bd640 1 --2- 172.21.15.43:0/586149511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc80ca7a0 0x7f9dc80cca30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0032000 tx=0x7f9dc0003f10 comp rx=0 tx=0).stop 2024-09-17T04:42:32.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.803+0000 7f9dd06bd640 1 -- 172.21.15.43:0/586149511 shutdown_connections 2024-09-17T04:42:32.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.803+0000 7f9dd06bd640 1 --2- 172.21.15.43:0/586149511 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9dac078b40 0x7f9dac07b050 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.803+0000 7f9dd06bd640 1 --2- 172.21.15.43:0/586149511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc80ca7a0 0x7f9dc80cca30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.803+0000 7f9dd06bd640 1 --2- 172.21.15.43:0/586149511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9dc80c9850 0x7f9dc80cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.803+0000 7f9dd06bd640 1 --2- 172.21.15.43:0/586149511 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc80c6990 0x7f9dc814ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.803+0000 7f9dd06bd640 1 -- 172.21.15.43:0/586149511 >> 172.21.15.43:0/586149511 conn(0x7f9dc806edc0 msgr2=0x7f9dc8076420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:42:32.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.803+0000 7f9dd06bd640 1 -- 172.21.15.43:0/586149511 shutdown_connections 2024-09-17T04:42:32.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.803+0000 7f9dd06bd640 1 -- 172.21.15.43:0/586149511 wait complete. 2024-09-17T04:42:32.814 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2024-09-17T04:42:31.019697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":631676,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":272,"num_write_kb":1729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240280,"kb_used_data":3280,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734440,"statfs":{"total":773094113280,"available":772848066560,"internally_reserved":0,"allocated":3358720,"data_stored":1973368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003451"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642826+0000","last_change":"2024-09-17T04:34:52.082794+0000","last_active":"2024-09-17T04:39:01.642826+0000","last_peered":"2024-09-17T04:39:01.642826+0000","last_clean":"2024-09-17T04:39:01.642826+0000","last_became_active":"2024-09-17T04:34:52.081216+0000","last_became_peered":"2024-09-17T04:34:52.081216+0000","last_unstale":"2024-09-17T04:39:01.642826+0000","last_undegraded":"2024-09-17T04:39:01.642826+0000","last_fullsized":"2024-09-17T04:39:01.642826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:32.229667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.639259+0000","last_change":"2024-09-17T04:34:52.071762+0000","last_active":"2024-09-17T04:39:04.639259+0000","last_peered":"2024-09-17T04:39:04.639259+0000","last_clean":"2024-09-17T04:39:04.639259+0000","last_became_active":"2024-09-17T04:34:52.071488+0000","last_became_peered":"2024-09-17T04:34:52.071488+0000","last_unstale":"2024-09-17T04:39:04.639259+0000","last_undegraded":"2024-09-17T04:39:04.639259+0000","last_fullsized":"2024-09-17T04:39:04.639259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:00.729921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.640068+0000","last_change":"2024-09-17T04:34:52.073360+0000","last_active":"2024-09-17T04:39:04.640068+0000","last_peered":"2024-09-17T04:39:04.640068+0000","last_clean":"2024-09-17T04:39:04.640068+0000","last_became_active":"2024-09-17T04:34:52.073014+0000","last_became_peered":"2024-09-17T04:34:52.073014+0000","last_unstale":"2024-09-17T04:39:04.640068+0000","last_undegraded":"2024-09-17T04:39:04.640068+0000","last_fullsized":"2024-09-17T04:39:04.640068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:14.331608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:51.641358+0000","last_change":"2024-09-17T04:34:52.077679+0000","last_active":"2024-09-17T04:38:51.641358+0000","last_peered":"2024-09-17T04:38:51.641358+0000","last_clean":"2024-09-17T04:38:51.641358+0000","last_became_active":"2024-09-17T04:34:52.077306+0000","last_became_peered":"2024-09-17T04:34:52.077306+0000","last_unstale":"2024-09-17T04:38:51.641358+0000","last_undegraded":"2024-09-17T04:38:51.641358+0000","last_fullsized":"2024-09-17T04:38:51.641358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:44.967159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.649003+0000","last_change":"2024-09-17T04:34:52.075036+0000","last_active":"2024-09-17T04:39:51.649003+0000","last_peered":"2024-09-17T04:39:51.649003+0000","last_clean":"2024-09-17T04:39:51.649003+0000","last_became_active":"2024-09-17T04:34:52.074649+0000","last_became_peered":"2024-09-17T04:34:52.074649+0000","last_unstale":"2024-09-17T04:39:51.649003+0000","last_undegraded":"2024-09-17T04:39:51.649003+0000","last_fullsized":"2024-09-17T04:39:51.649003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:22.293746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.648728+0000","last_change":"2024-09-17T04:34:52.081059+0000","last_active":"2024-09-17T04:39:51.648728+0000","last_peered":"2024-09-17T04:39:51.648728+0000","last_clean":"2024-09-17T04:39:51.648728+0000","last_became_active":"2024-09-17T04:34:52.080677+0000","last_became_peered":"2024-09-17T04:34:52.080677+0000","last_unstale":"2024-09-17T04:39:51.648728+0000","last_undegraded":"2024-09-17T04:39:51.648728+0000","last_fullsized":"2024-09-17T04:39:51.648728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:52.404672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.648979+0000","last_change":"2024-09-17T04:34:52.071135+0000","last_active":"2024-09-17T04:39:51.648979+0000","last_peered":"2024-09-17T04:39:51.648979+0000","last_clean":"2024-09-17T04:39:51.648979+0000","last_became_active":"2024-09-17T04:34:52.070844+0000","last_became_peered":"2024-09-17T04:34:52.070844+0000","last_unstale":"2024-09-17T04:39:51.648979+0000","last_undegraded":"2024-09-17T04:39:51.648979+0000","last_fullsized":"2024-09-17T04:39:51.648979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:02.373675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:54.645651+0000","last_change":"2024-09-17T04:34:52.083343+0000","last_active":"2024-09-17T04:39:54.645651+0000","last_peered":"2024-09-17T04:39:54.645651+0000","last_clean":"2024-09-17T04:39:54.645651+0000","last_became_active":"2024-09-17T04:34:52.083008+0000","last_became_peered":"2024-09-17T04:34:52.083008+0000","last_unstale":"2024-09-17T04:39:54.645651+0000","last_undegraded":"2024-09-17T04:39:54.645651+0000","last_fullsized":"2024-09-17T04:39:54.645651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:02.710077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647730+0000","last_change":"2024-09-17T04:34:52.083331+0000","last_active":"2024-09-17T04:39:41.647730+0000","last_peered":"2024-09-17T04:39:41.647730+0000","last_clean":"2024-09-17T04:39:41.647730+0000","last_became_active":"2024-09-17T04:34:52.082984+0000","last_became_peered":"2024-09-17T04:34:52.082984+0000","last_unstale":"2024-09-17T04:39:41.647730+0000","last_undegraded":"2024-09-17T04:39:41.647730+0000","last_fullsized":"2024-09-17T04:39:41.647730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:56.779776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647120+0000","last_change":"2024-09-17T04:34:52.087207+0000","last_active":"2024-09-17T04:39:41.647120+0000","last_peered":"2024-09-17T04:39:41.647120+0000","last_clean":"2024-09-17T04:39:41.647120+0000","last_became_active":"2024-09-17T04:34:52.086885+0000","last_became_peered":"2024-09-17T04:34:52.086885+0000","last_unstale":"2024-09-17T04:39:41.647120+0000","last_undegraded":"2024-09-17T04:39:41.647120+0000","last_fullsized":"2024-09-17T04:39:41.647120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:52.121338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647093+0000","last_change":"2024-09-17T04:34:52.086309+0000","last_active":"2024-09-17T04:39:41.647093+0000","last_peered":"2024-09-17T04:39:41.647093+0000","last_clean":"2024-09-17T04:39:41.647093+0000","last_became_active":"2024-09-17T04:34:52.085996+0000","last_became_peered":"2024-09-17T04:34:52.085996+0000","last_unstale":"2024-09-17T04:39:41.647093+0000","last_undegraded":"2024-09-17T04:39:41.647093+0000","last_fullsized":"2024-09-17T04:39:41.647093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:58.004980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647237+0000","last_change":"2024-09-17T04:34:52.077080+0000","last_active":"2024-09-17T04:39:41.647237+0000","last_peered":"2024-09-17T04:39:41.647237+0000","last_clean":"2024-09-17T04:39:41.647237+0000","last_became_active":"2024-09-17T04:34:52.076756+0000","last_became_peered":"2024-09-17T04:34:52.076756+0000","last_unstale":"2024-09-17T04:39:41.647237+0000","last_undegraded":"2024-09-17T04:39:41.647237+0000","last_fullsized":"2024-09-17T04:39:41.647237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:48.044400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644400+0000","last_change":"2024-09-17T04:34:52.076609+0000","last_active":"2024-09-17T04:39:44.644400+0000","last_peered":"2024-09-17T04:39:44.644400+0000","last_clean":"2024-09-17T04:39:44.644400+0000","last_became_active":"2024-09-17T04:34:52.076277+0000","last_became_peered":"2024-09-17T04:34:52.076277+0000","last_unstale":"2024-09-17T04:39:44.644400+0000","last_undegraded":"2024-09-17T04:39:44.644400+0000","last_fullsized":"2024-09-17T04:39:44.644400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:28.537566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'3","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.643368+0000","last_change":"2024-09-17T04:34:52.076754+0000","last_active":"2024-09-17T04:39:34.643368+0000","last_peered":"2024-09-17T04:39:34.643368+0000","last_clean":"2024-09-17T04:39:34.643368+0000","last_became_active":"2024-09-17T04:34:52.076261+0000","last_became_peered":"2024-09-17T04:34:52.076261+0000","last_unstale":"2024-09-17T04:39:34.643368+0000","last_undegraded":"2024-09-17T04:39:34.643368+0000","last_fullsized":"2024-09-17T04:39:34.643368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:51.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.642967+0000","last_change":"2024-09-17T04:34:52.079161+0000","last_active":"2024-09-17T04:39:34.642967+0000","last_peered":"2024-09-17T04:39:34.642967+0000","last_clean":"2024-09-17T04:39:34.642967+0000","last_became_active":"2024-09-17T04:34:52.078782+0000","last_became_peered":"2024-09-17T04:34:52.078782+0000","last_unstale":"2024-09-17T04:39:34.642967+0000","last_undegraded":"2024-09-17T04:39:34.642967+0000","last_fullsized":"2024-09-17T04:39:34.642967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:06.894137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.646038+0000","last_change":"2024-09-17T04:34:52.070767+0000","last_active":"2024-09-17T04:39:31.646038+0000","last_peered":"2024-09-17T04:39:31.646038+0000","last_clean":"2024-09-17T04:39:31.646038+0000","last_became_active":"2024-09-17T04:34:52.070428+0000","last_became_peered":"2024-09-17T04:34:52.070428+0000","last_unstale":"2024-09-17T04:39:31.646038+0000","last_undegraded":"2024-09-17T04:39:31.646038+0000","last_fullsized":"2024-09-17T04:39:31.646038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:42.820391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.646123+0000","last_change":"2024-09-17T04:34:52.077238+0000","last_active":"2024-09-17T04:39:31.646123+0000","last_peered":"2024-09-17T04:39:31.646123+0000","last_clean":"2024-09-17T04:39:31.646123+0000","last_became_active":"2024-09-17T04:34:52.076897+0000","last_became_peered":"2024-09-17T04:34:52.076897+0000","last_unstale":"2024-09-17T04:39:31.646123+0000","last_undegraded":"2024-09-17T04:39:31.646123+0000","last_fullsized":"2024-09-17T04:39:31.646123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:27.431184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.643014+0000","last_change":"2024-09-17T04:34:52.080917+0000","last_active":"2024-09-17T04:39:34.643014+0000","last_peered":"2024-09-17T04:39:34.643014+0000","last_clean":"2024-09-17T04:39:34.643014+0000","last_became_active":"2024-09-17T04:34:52.080597+0000","last_became_peered":"2024-09-17T04:34:52.080597+0000","last_unstale":"2024-09-17T04:39:34.643014+0000","last_undegraded":"2024-09-17T04:39:34.643014+0000","last_fullsized":"2024-09-17T04:39:34.643014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:10.560075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.645213+0000","last_change":"2024-09-17T04:34:52.077284+0000","last_active":"2024-09-17T04:39:21.645213+0000","last_peered":"2024-09-17T04:39:21.645213+0000","last_clean":"2024-09-17T04:39:21.645213+0000","last_became_active":"2024-09-17T04:34:52.076950+0000","last_became_peered":"2024-09-17T04:34:52.076950+0000","last_unstale":"2024-09-17T04:39:21.645213+0000","last_undegraded":"2024-09-17T04:39:21.645213+0000","last_fullsized":"2024-09-17T04:39:21.645213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:06.361530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.644550+0000","last_change":"2024-09-17T04:34:52.083859+0000","last_active":"2024-09-17T04:39:21.644550+0000","last_peered":"2024-09-17T04:39:21.644550+0000","last_clean":"2024-09-17T04:39:21.644550+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:39:21.644550+0000","last_undegraded":"2024-09-17T04:39:21.644550+0000","last_fullsized":"2024-09-17T04:39:21.644550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:25.262925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.642080+0000","last_change":"2024-09-17T04:34:52.086460+0000","last_active":"2024-09-17T04:39:24.642080+0000","last_peered":"2024-09-17T04:39:24.642080+0000","last_clean":"2024-09-17T04:39:24.642080+0000","last_became_active":"2024-09-17T04:34:52.084848+0000","last_became_peered":"2024-09-17T04:34:52.084848+0000","last_unstale":"2024-09-17T04:39:24.642080+0000","last_undegraded":"2024-09-17T04:39:24.642080+0000","last_fullsized":"2024-09-17T04:39:24.642080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:22.927331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.644942+0000","last_change":"2024-09-17T04:34:52.080149+0000","last_active":"2024-09-17T04:39:21.644942+0000","last_peered":"2024-09-17T04:39:21.644942+0000","last_clean":"2024-09-17T04:39:21.644942+0000","last_became_active":"2024-09-17T04:34:52.079490+0000","last_became_peered":"2024-09-17T04:34:52.079490+0000","last_unstale":"2024-09-17T04:39:21.644942+0000","last_undegraded":"2024-09-17T04:39:21.644942+0000","last_fullsized":"2024-09-17T04:39:21.644942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:52.314715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.641891+0000","last_change":"2024-09-17T04:34:52.082765+0000","last_active":"2024-09-17T04:39:24.641891+0000","last_peered":"2024-09-17T04:39:24.641891+0000","last_clean":"2024-09-17T04:39:24.641891+0000","last_became_active":"2024-09-17T04:34:52.081049+0000","last_became_peered":"2024-09-17T04:34:52.081049+0000","last_unstale":"2024-09-17T04:39:24.641891+0000","last_undegraded":"2024-09-17T04:39:24.641891+0000","last_fullsized":"2024-09-17T04:39:24.641891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.762553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:11.643792+0000","last_change":"2024-09-17T04:34:52.086233+0000","last_active":"2024-09-17T04:39:11.643792+0000","last_peered":"2024-09-17T04:39:11.643792+0000","last_clean":"2024-09-17T04:39:11.643792+0000","last_became_active":"2024-09-17T04:34:52.085876+0000","last_became_peered":"2024-09-17T04:34:52.085876+0000","last_unstale":"2024-09-17T04:39:11.643792+0000","last_undegraded":"2024-09-17T04:39:11.643792+0000","last_fullsized":"2024-09-17T04:39:11.643792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:44.061677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640892+0000","last_change":"2024-09-17T04:34:52.079305+0000","last_active":"2024-09-17T04:39:14.640892+0000","last_peered":"2024-09-17T04:39:14.640892+0000","last_clean":"2024-09-17T04:39:14.640892+0000","last_became_active":"2024-09-17T04:34:52.078984+0000","last_became_peered":"2024-09-17T04:34:52.078984+0000","last_unstale":"2024-09-17T04:39:14.640892+0000","last_undegraded":"2024-09-17T04:39:14.640892+0000","last_fullsized":"2024-09-17T04:39:14.640892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:15.927488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:11.643367+0000","last_change":"2024-09-17T04:34:52.077495+0000","last_active":"2024-09-17T04:39:11.643367+0000","last_peered":"2024-09-17T04:39:11.643367+0000","last_clean":"2024-09-17T04:39:11.643367+0000","last_became_active":"2024-09-17T04:34:52.077167+0000","last_became_peered":"2024-09-17T04:34:52.077167+0000","last_unstale":"2024-09-17T04:39:11.643367+0000","last_undegraded":"2024-09-17T04:39:11.643367+0000","last_fullsized":"2024-09-17T04:39:11.643367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.411611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640431+0000","last_change":"2024-09-17T04:34:52.077389+0000","last_active":"2024-09-17T04:39:14.640431+0000","last_peered":"2024-09-17T04:39:14.640431+0000","last_clean":"2024-09-17T04:39:14.640431+0000","last_became_active":"2024-09-17T04:34:52.076993+0000","last_became_peered":"2024-09-17T04:34:52.076993+0000","last_unstale":"2024-09-17T04:39:14.640431+0000","last_undegraded":"2024-09-17T04:39:14.640431+0000","last_fullsized":"2024-09-17T04:39:14.640431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:18.540098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640877+0000","last_change":"2024-09-17T04:34:52.080545+0000","last_active":"2024-09-17T04:39:14.640877+0000","last_peered":"2024-09-17T04:39:14.640877+0000","last_clean":"2024-09-17T04:39:14.640877+0000","last_became_active":"2024-09-17T04:34:52.079930+0000","last_became_peered":"2024-09-17T04:34:52.079930+0000","last_unstale":"2024-09-17T04:39:14.640877+0000","last_undegraded":"2024-09-17T04:39:14.640877+0000","last_fullsized":"2024-09-17T04:39:14.640877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:50.491050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.640051+0000","last_change":"2024-09-17T04:34:52.083598+0000","last_active":"2024-09-17T04:39:04.640051+0000","last_peered":"2024-09-17T04:39:04.640051+0000","last_clean":"2024-09-17T04:39:04.640051+0000","last_became_active":"2024-09-17T04:34:52.083225+0000","last_became_peered":"2024-09-17T04:34:52.083225+0000","last_unstale":"2024-09-17T04:39:04.640051+0000","last_undegraded":"2024-09-17T04:39:04.640051+0000","last_fullsized":"2024-09-17T04:39:04.640051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:22.713546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:49.644963+0000","last_change":"2024-09-17T04:35:37.193329+0000","last_active":"2024-09-17T04:39:49.644963+0000","last_peered":"2024-09-17T04:39:49.644963+0000","last_clean":"2024-09-17T04:39:49.644963+0000","last_became_active":"2024-09-17T04:35:37.192946+0000","last_became_peered":"2024-09-17T04:35:37.192946+0000","last_unstale":"2024-09-17T04:39:49.644963+0000","last_undegraded":"2024-09-17T04:39:49.644963+0000","last_fullsized":"2024-09-17T04:39:49.644963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:08.179268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.639160+0000","last_change":"2024-09-17T04:34:52.082113+0000","last_active":"2024-09-17T04:39:04.639160+0000","last_peered":"2024-09-17T04:39:04.639160+0000","last_clean":"2024-09-17T04:39:04.639160+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:39:04.639160+0000","last_undegraded":"2024-09-17T04:39:04.639160+0000","last_fullsized":"2024-09-17T04:39:04.639160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:52.744564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642099+0000","last_change":"2024-09-17T04:34:52.083306+0000","last_active":"2024-09-17T04:39:01.642099+0000","last_peered":"2024-09-17T04:39:01.642099+0000","last_clean":"2024-09-17T04:39:01.642099+0000","last_became_active":"2024-09-17T04:34:52.082590+0000","last_became_peered":"2024-09-17T04:34:52.082590+0000","last_unstale":"2024-09-17T04:39:01.642099+0000","last_undegraded":"2024-09-17T04:39:01.642099+0000","last_fullsized":"2024-09-17T04:39:01.642099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:21.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.648446+0000","last_change":"2024-09-17T04:34:52.070155+0000","last_active":"2024-09-17T04:39:51.648446+0000","last_peered":"2024-09-17T04:39:51.648446+0000","last_clean":"2024-09-17T04:39:51.648446+0000","last_became_active":"2024-09-17T04:34:52.069498+0000","last_became_peered":"2024-09-17T04:34:52.069498+0000","last_unstale":"2024-09-17T04:39:51.648446+0000","last_undegraded":"2024-09-17T04:39:51.648446+0000","last_fullsized":"2024-09-17T04:39:51.648446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:24.539277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:54.645708+0000","last_change":"2024-09-17T04:34:51.074188+0000","last_active":"2024-09-17T04:39:54.645708+0000","last_peered":"2024-09-17T04:39:54.645708+0000","last_clean":"2024-09-17T04:39:54.645708+0000","last_became_active":"2024-09-17T04:34:51.073740+0000","last_became_peered":"2024-09-17T04:34:51.073740+0000","last_unstale":"2024-09-17T04:39:54.645708+0000","last_undegraded":"2024-09-17T04:39:54.645708+0000","last_fullsized":"2024-09-17T04:39:54.645708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:36.692687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:54.645926+0000","last_change":"2024-09-17T04:34:52.081048+0000","last_active":"2024-09-17T04:39:54.645926+0000","last_peered":"2024-09-17T04:39:54.645926+0000","last_clean":"2024-09-17T04:39:54.645926+0000","last_became_active":"2024-09-17T04:34:52.080703+0000","last_became_peered":"2024-09-17T04:34:52.080703+0000","last_unstale":"2024-09-17T04:39:54.645926+0000","last_undegraded":"2024-09-17T04:39:54.645926+0000","last_fullsized":"2024-09-17T04:39:54.645926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:05.164849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.648336+0000","last_change":"2024-09-17T04:34:51.078602+0000","last_active":"2024-09-17T04:39:51.648336+0000","last_peered":"2024-09-17T04:39:51.648336+0000","last_clean":"2024-09-17T04:39:51.648336+0000","last_became_active":"2024-09-17T04:34:51.078221+0000","last_became_peered":"2024-09-17T04:34:51.078221+0000","last_unstale":"2024-09-17T04:39:51.648336+0000","last_undegraded":"2024-09-17T04:39:51.648336+0000","last_fullsized":"2024-09-17T04:39:51.648336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:59.716216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644377+0000","last_change":"2024-09-17T04:34:51.077573+0000","last_active":"2024-09-17T04:39:44.644377+0000","last_peered":"2024-09-17T04:39:44.644377+0000","last_clean":"2024-09-17T04:39:44.644377+0000","last_became_active":"2024-09-17T04:34:51.077225+0000","last_became_peered":"2024-09-17T04:34:51.077225+0000","last_unstale":"2024-09-17T04:39:44.644377+0000","last_undegraded":"2024-09-17T04:39:44.644377+0000","last_fullsized":"2024-09-17T04:39:44.644377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:29.348927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644335+0000","last_change":"2024-09-17T04:34:52.074356+0000","last_active":"2024-09-17T04:39:44.644335+0000","last_peered":"2024-09-17T04:39:44.644335+0000","last_clean":"2024-09-17T04:39:44.644335+0000","last_became_active":"2024-09-17T04:34:52.072796+0000","last_became_peered":"2024-09-17T04:34:52.072796+0000","last_unstale":"2024-09-17T04:39:44.644335+0000","last_undegraded":"2024-09-17T04:39:44.644335+0000","last_fullsized":"2024-09-17T04:39:44.644335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:53.971839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647411+0000","last_change":"2024-09-17T04:34:51.074170+0000","last_active":"2024-09-17T04:39:41.647411+0000","last_peered":"2024-09-17T04:39:41.647411+0000","last_clean":"2024-09-17T04:39:41.647411+0000","last_became_active":"2024-09-17T04:34:51.073836+0000","last_became_peered":"2024-09-17T04:34:51.073836+0000","last_unstale":"2024-09-17T04:39:41.647411+0000","last_undegraded":"2024-09-17T04:39:41.647411+0000","last_fullsized":"2024-09-17T04:39:41.647411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:30.884002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644326+0000","last_change":"2024-09-17T04:34:52.078331+0000","last_active":"2024-09-17T04:39:44.644326+0000","last_peered":"2024-09-17T04:39:44.644326+0000","last_clean":"2024-09-17T04:39:44.644326+0000","last_became_active":"2024-09-17T04:34:52.078012+0000","last_became_peered":"2024-09-17T04:34:52.078012+0000","last_unstale":"2024-09-17T04:39:44.644326+0000","last_undegraded":"2024-09-17T04:39:44.644326+0000","last_fullsized":"2024-09-17T04:39:44.644326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:28.961571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647134+0000","last_change":"2024-09-17T04:34:51.077676+0000","last_active":"2024-09-17T04:39:41.647134+0000","last_peered":"2024-09-17T04:39:41.647134+0000","last_clean":"2024-09-17T04:39:41.647134+0000","last_became_active":"2024-09-17T04:34:51.076291+0000","last_became_peered":"2024-09-17T04:34:51.076291+0000","last_unstale":"2024-09-17T04:39:41.647134+0000","last_undegraded":"2024-09-17T04:39:41.647134+0000","last_fullsized":"2024-09-17T04:39:41.647134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:42.622688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:04.631764+0000","last_change":"2024-09-17T04:35:37.194320+0000","last_active":"2024-09-17T04:38:04.631764+0000","last_peered":"2024-09-17T04:38:04.631764+0000","last_clean":"2024-09-17T04:38:04.631764+0000","last_became_active":"2024-09-17T04:35:37.193979+0000","last_became_peered":"2024-09-17T04:35:37.193979+0000","last_unstale":"2024-09-17T04:38:04.631764+0000","last_undegraded":"2024-09-17T04:38:04.631764+0000","last_fullsized":"2024-09-17T04:38:04.631764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:17.056823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647472+0000","last_change":"2024-09-17T04:34:51.077199+0000","last_active":"2024-09-17T04:39:41.647472+0000","last_peered":"2024-09-17T04:39:41.647472+0000","last_clean":"2024-09-17T04:39:41.647472+0000","last_became_active":"2024-09-17T04:34:51.076867+0000","last_became_peered":"2024-09-17T04:34:51.076867+0000","last_unstale":"2024-09-17T04:39:41.647472+0000","last_undegraded":"2024-09-17T04:39:41.647472+0000","last_fullsized":"2024-09-17T04:39:41.647472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:09.194133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644651+0000","last_change":"2024-09-17T04:34:52.083401+0000","last_active":"2024-09-17T04:39:44.644651+0000","last_peered":"2024-09-17T04:39:44.644651+0000","last_clean":"2024-09-17T04:39:44.644651+0000","last_became_active":"2024-09-17T04:34:52.083086+0000","last_became_peered":"2024-09-17T04:34:52.083086+0000","last_unstale":"2024-09-17T04:39:44.644651+0000","last_undegraded":"2024-09-17T04:39:44.644651+0000","last_fullsized":"2024-09-17T04:39:44.644651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.237945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'7","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644384+0000","last_change":"2024-09-17T04:34:51.070235+0000","last_active":"2024-09-17T04:39:44.644384+0000","last_peered":"2024-09-17T04:39:44.644384+0000","last_clean":"2024-09-17T04:39:44.644384+0000","last_became_active":"2024-09-17T04:34:51.069278+0000","last_became_peered":"2024-09-17T04:34:51.069278+0000","last_unstale":"2024-09-17T04:39:44.644384+0000","last_undegraded":"2024-09-17T04:39:44.644384+0000","last_fullsized":"2024-09-17T04:39:44.644384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:55.959278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.645807+0000","last_change":"2024-09-17T04:34:52.076233+0000","last_active":"2024-09-17T04:39:31.645807+0000","last_peered":"2024-09-17T04:39:31.645807+0000","last_clean":"2024-09-17T04:39:31.645807+0000","last_became_active":"2024-09-17T04:34:52.075682+0000","last_became_peered":"2024-09-17T04:34:52.075682+0000","last_unstale":"2024-09-17T04:39:31.645807+0000","last_undegraded":"2024-09-17T04:39:31.645807+0000","last_fullsized":"2024-09-17T04:39:31.645807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:22.047574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'25","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.645795+0000","last_change":"2024-09-17T04:34:51.076416+0000","last_active":"2024-09-17T04:39:31.645795+0000","last_peered":"2024-09-17T04:39:31.645795+0000","last_clean":"2024-09-17T04:39:31.645795+0000","last_became_active":"2024-09-17T04:34:51.076051+0000","last_became_peered":"2024-09-17T04:34:51.076051+0000","last_unstale":"2024-09-17T04:39:31.645795+0000","last_undegraded":"2024-09-17T04:39:31.645795+0000","last_fullsized":"2024-09-17T04:39:31.645795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:52.255204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37038,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647683+0000","last_change":"2024-09-17T04:34:52.086230+0000","last_active":"2024-09-17T04:39:41.647683+0000","last_peered":"2024-09-17T04:39:41.647683+0000","last_clean":"2024-09-17T04:39:41.647683+0000","last_became_active":"2024-09-17T04:34:52.085910+0000","last_became_peered":"2024-09-17T04:34:52.085910+0000","last_unstale":"2024-09-17T04:39:41.647683+0000","last_undegraded":"2024-09-17T04:39:41.647683+0000","last_fullsized":"2024-09-17T04:39:41.647683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:36.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.643405+0000","last_change":"2024-09-17T04:34:51.075224+0000","last_active":"2024-09-17T04:39:34.643405+0000","last_peered":"2024-09-17T04:39:34.643405+0000","last_clean":"2024-09-17T04:39:34.643405+0000","last_became_active":"2024-09-17T04:34:51.074912+0000","last_became_peered":"2024-09-17T04:34:51.074912+0000","last_unstale":"2024-09-17T04:39:34.643405+0000","last_undegraded":"2024-09-17T04:39:34.643405+0000","last_fullsized":"2024-09-17T04:39:34.643405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:33.811243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.643389+0000","last_change":"2024-09-17T04:34:52.085906+0000","last_active":"2024-09-17T04:39:34.643389+0000","last_peered":"2024-09-17T04:39:34.643389+0000","last_clean":"2024-09-17T04:39:34.643389+0000","last_became_active":"2024-09-17T04:34:52.085538+0000","last_became_peered":"2024-09-17T04:34:52.085538+0000","last_unstale":"2024-09-17T04:39:34.643389+0000","last_undegraded":"2024-09-17T04:39:34.643389+0000","last_fullsized":"2024-09-17T04:39:34.643389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:21.997395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.646079+0000","last_change":"2024-09-17T04:34:51.074253+0000","last_active":"2024-09-17T04:39:31.646079+0000","last_peered":"2024-09-17T04:39:31.646079+0000","last_clean":"2024-09-17T04:39:31.646079+0000","last_became_active":"2024-09-17T04:34:51.073812+0000","last_became_peered":"2024-09-17T04:34:51.073812+0000","last_unstale":"2024-09-17T04:39:31.646079+0000","last_undegraded":"2024-09-17T04:39:31.646079+0000","last_fullsized":"2024-09-17T04:39:31.646079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:38.971561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.646447+0000","last_change":"2024-09-17T04:34:52.082137+0000","last_active":"2024-09-17T04:39:31.646447+0000","last_peered":"2024-09-17T04:39:31.646447+0000","last_clean":"2024-09-17T04:39:31.646447+0000","last_became_active":"2024-09-17T04:34:52.081775+0000","last_became_peered":"2024-09-17T04:34:52.081775+0000","last_unstale":"2024-09-17T04:39:31.646447+0000","last_undegraded":"2024-09-17T04:39:31.646447+0000","last_fullsized":"2024-09-17T04:39:31.646447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:57.911822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.645765+0000","last_change":"2024-09-17T04:34:51.077157+0000","last_active":"2024-09-17T04:39:31.645765+0000","last_peered":"2024-09-17T04:39:31.645765+0000","last_clean":"2024-09-17T04:39:31.645765+0000","last_became_active":"2024-09-17T04:34:51.076797+0000","last_became_peered":"2024-09-17T04:34:51.076797+0000","last_unstale":"2024-09-17T04:39:31.645765+0000","last_undegraded":"2024-09-17T04:39:31.645765+0000","last_fullsized":"2024-09-17T04:39:31.645765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:20.118978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":844,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.645738+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:39:31.645738+0000","last_peered":"2024-09-17T04:39:31.645738+0000","last_clean":"2024-09-17T04:39:31.645738+0000","last_became_active":"2024-09-17T04:34:52.082118+0000","last_became_peered":"2024-09-17T04:34:52.082118+0000","last_unstale":"2024-09-17T04:39:31.645738+0000","last_undegraded":"2024-09-17T04:39:31.645738+0000","last_fullsized":"2024-09-17T04:39:31.645738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:44.752945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'16","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.642945+0000","last_change":"2024-09-17T04:34:51.071083+0000","last_active":"2024-09-17T04:39:34.642945+0000","last_peered":"2024-09-17T04:39:34.642945+0000","last_clean":"2024-09-17T04:39:34.642945+0000","last_became_active":"2024-09-17T04:34:51.070733+0000","last_became_peered":"2024-09-17T04:34:51.070733+0000","last_unstale":"2024-09-17T04:39:34.642945+0000","last_undegraded":"2024-09-17T04:39:34.642945+0000","last_fullsized":"2024-09-17T04:39:34.642945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:36.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.646422+0000","last_change":"2024-09-17T04:34:52.080277+0000","last_active":"2024-09-17T04:39:31.646422+0000","last_peered":"2024-09-17T04:39:31.646422+0000","last_clean":"2024-09-17T04:39:31.646422+0000","last_became_active":"2024-09-17T04:34:52.079969+0000","last_became_peered":"2024-09-17T04:34:52.079969+0000","last_unstale":"2024-09-17T04:39:31.646422+0000","last_undegraded":"2024-09-17T04:39:31.646422+0000","last_fullsized":"2024-09-17T04:39:31.646422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:10.360905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.644561+0000","last_change":"2024-09-17T04:34:51.074800+0000","last_active":"2024-09-17T04:39:21.644561+0000","last_peered":"2024-09-17T04:39:21.644561+0000","last_clean":"2024-09-17T04:39:21.644561+0000","last_became_active":"2024-09-17T04:34:51.073287+0000","last_became_peered":"2024-09-17T04:34:51.073287+0000","last_unstale":"2024-09-17T04:39:21.644561+0000","last_undegraded":"2024-09-17T04:39:21.644561+0000","last_fullsized":"2024-09-17T04:39:21.644561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:19.933857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.645232+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:39:21.645232+0000","last_peered":"2024-09-17T04:39:21.645232+0000","last_clean":"2024-09-17T04:39:21.645232+0000","last_became_active":"2024-09-17T04:34:52.082607+0000","last_became_peered":"2024-09-17T04:34:52.082607+0000","last_unstale":"2024-09-17T04:39:21.645232+0000","last_undegraded":"2024-09-17T04:39:21.645232+0000","last_fullsized":"2024-09-17T04:39:21.645232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:08.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.641560+0000","last_change":"2024-09-17T04:34:51.077171+0000","last_active":"2024-09-17T04:39:24.641560+0000","last_peered":"2024-09-17T04:39:24.641560+0000","last_clean":"2024-09-17T04:39:24.641560+0000","last_became_active":"2024-09-17T04:34:51.076780+0000","last_became_peered":"2024-09-17T04:34:51.076780+0000","last_unstale":"2024-09-17T04:39:24.641560+0000","last_undegraded":"2024-09-17T04:39:24.641560+0000","last_fullsized":"2024-09-17T04:39:24.641560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:40.031852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.645255+0000","last_change":"2024-09-17T04:34:52.080032+0000","last_active":"2024-09-17T04:39:21.645255+0000","last_peered":"2024-09-17T04:39:21.645255+0000","last_clean":"2024-09-17T04:39:21.645255+0000","last_became_active":"2024-09-17T04:34:52.079536+0000","last_became_peered":"2024-09-17T04:34:52.079536+0000","last_unstale":"2024-09-17T04:39:21.645255+0000","last_undegraded":"2024-09-17T04:39:21.645255+0000","last_fullsized":"2024-09-17T04:39:21.645255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:55.220027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.641570+0000","last_change":"2024-09-17T04:34:51.071053+0000","last_active":"2024-09-17T04:39:24.641570+0000","last_peered":"2024-09-17T04:39:24.641570+0000","last_clean":"2024-09-17T04:39:24.641570+0000","last_became_active":"2024-09-17T04:34:51.070673+0000","last_became_peered":"2024-09-17T04:34:51.070673+0000","last_unstale":"2024-09-17T04:39:24.641570+0000","last_undegraded":"2024-09-17T04:39:24.641570+0000","last_fullsized":"2024-09-17T04:39:24.641570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:31.660200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.644973+0000","last_change":"2024-09-17T04:34:52.077963+0000","last_active":"2024-09-17T04:39:21.644973+0000","last_peered":"2024-09-17T04:39:21.644973+0000","last_clean":"2024-09-17T04:39:21.644973+0000","last_became_active":"2024-09-17T04:34:52.077499+0000","last_became_peered":"2024-09-17T04:34:52.077499+0000","last_unstale":"2024-09-17T04:39:21.644973+0000","last_undegraded":"2024-09-17T04:39:21.644973+0000","last_fullsized":"2024-09-17T04:39:21.644973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:25.309696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.641526+0000","last_change":"2024-09-17T04:34:51.070532+0000","last_active":"2024-09-17T04:39:24.641526+0000","last_peered":"2024-09-17T04:39:24.641526+0000","last_clean":"2024-09-17T04:39:24.641526+0000","last_became_active":"2024-09-17T04:34:51.070179+0000","last_became_peered":"2024-09-17T04:34:51.070179+0000","last_unstale":"2024-09-17T04:39:24.641526+0000","last_undegraded":"2024-09-17T04:39:24.641526+0000","last_fullsized":"2024-09-17T04:39:24.641526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:52.027096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.645192+0000","last_change":"2024-09-17T04:34:52.083159+0000","last_active":"2024-09-17T04:39:21.645192+0000","last_peered":"2024-09-17T04:39:21.645192+0000","last_clean":"2024-09-17T04:39:21.645192+0000","last_became_active":"2024-09-17T04:34:52.082847+0000","last_became_peered":"2024-09-17T04:34:52.082847+0000","last_unstale":"2024-09-17T04:39:21.645192+0000","last_undegraded":"2024-09-17T04:39:21.645192+0000","last_fullsized":"2024-09-17T04:39:21.645192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:25.210506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:41.640327+0000","last_change":"2024-09-17T04:34:41.975789+0000","last_active":"2024-09-17T04:38:41.640327+0000","last_peered":"2024-09-17T04:38:41.640327+0000","last_clean":"2024-09-17T04:38:41.640327+0000","last_became_active":"2024-09-17T04:34:41.974664+0000","last_became_peered":"2024-09-17T04:34:41.974664+0000","last_unstale":"2024-09-17T04:38:41.640327+0000","last_undegraded":"2024-09-17T04:38:41.640327+0000","last_fullsized":"2024-09-17T04:38:41.640327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_clean_scrub_stamp":"2024-09-17T04:34:39.702713+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:30.302931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642564+0000","last_change":"2024-09-17T04:34:51.068782+0000","last_active":"2024-09-17T04:39:01.642564+0000","last_peered":"2024-09-17T04:39:01.642564+0000","last_clean":"2024-09-17T04:39:01.642564+0000","last_became_active":"2024-09-17T04:34:51.068375+0000","last_became_peered":"2024-09-17T04:34:51.068375+0000","last_unstale":"2024-09-17T04:39:01.642564+0000","last_undegraded":"2024-09-17T04:39:01.642564+0000","last_fullsized":"2024-09-17T04:39:01.642564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:25.307166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:49.644929+0000","last_change":"2024-09-17T04:35:37.196118+0000","last_active":"2024-09-17T04:39:49.644929+0000","last_peered":"2024-09-17T04:39:49.644929+0000","last_clean":"2024-09-17T04:39:49.644929+0000","last_became_active":"2024-09-17T04:35:37.195780+0000","last_became_peered":"2024-09-17T04:35:37.195780+0000","last_unstale":"2024-09-17T04:39:49.644929+0000","last_undegraded":"2024-09-17T04:39:49.644929+0000","last_fullsized":"2024-09-17T04:39:49.644929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:48.569400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:51.641567+0000","last_change":"2024-09-17T04:34:51.075655+0000","last_active":"2024-09-17T04:38:51.641567+0000","last_peered":"2024-09-17T04:38:51.641567+0000","last_clean":"2024-09-17T04:38:51.641567+0000","last_became_active":"2024-09-17T04:34:51.075313+0000","last_became_peered":"2024-09-17T04:34:51.075313+0000","last_unstale":"2024-09-17T04:38:51.641567+0000","last_undegraded":"2024-09-17T04:38:51.641567+0000","last_fullsized":"2024-09-17T04:38:51.641567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:47.853850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.640022+0000","last_change":"2024-09-17T04:34:52.080065+0000","last_active":"2024-09-17T04:39:04.640022+0000","last_peered":"2024-09-17T04:39:04.640022+0000","last_clean":"2024-09-17T04:39:04.640022+0000","last_became_active":"2024-09-17T04:34:52.079672+0000","last_became_peered":"2024-09-17T04:34:52.079672+0000","last_unstale":"2024-09-17T04:39:04.640022+0000","last_undegraded":"2024-09-17T04:39:04.640022+0000","last_fullsized":"2024-09-17T04:39:04.640022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:52.040153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"24'8","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.639201+0000","last_change":"2024-09-17T04:34:51.075960+0000","last_active":"2024-09-17T04:39:04.639201+0000","last_peered":"2024-09-17T04:39:04.639201+0000","last_clean":"2024-09-17T04:39:04.639201+0000","last_became_active":"2024-09-17T04:34:51.075561+0000","last_became_peered":"2024-09-17T04:34:51.075561+0000","last_unstale":"2024-09-17T04:39:04.639201+0000","last_undegraded":"2024-09-17T04:39:04.639201+0000","last_fullsized":"2024-09-17T04:39:04.639201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:44.834618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:54.637775+0000","last_change":"2024-09-17T04:34:52.070068+0000","last_active":"2024-09-17T04:38:54.637775+0000","last_peered":"2024-09-17T04:38:54.637775+0000","last_clean":"2024-09-17T04:38:54.637775+0000","last_became_active":"2024-09-17T04:34:52.069669+0000","last_became_peered":"2024-09-17T04:34:52.069669+0000","last_unstale":"2024-09-17T04:38:54.637775+0000","last_undegraded":"2024-09-17T04:38:54.637775+0000","last_fullsized":"2024-09-17T04:38:54.637775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:39.617045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642537+0000","last_change":"2024-09-17T04:34:51.070187+0000","last_active":"2024-09-17T04:39:01.642537+0000","last_peered":"2024-09-17T04:39:01.642537+0000","last_clean":"2024-09-17T04:39:01.642537+0000","last_became_active":"2024-09-17T04:34:51.069714+0000","last_became_peered":"2024-09-17T04:34:51.069714+0000","last_unstale":"2024-09-17T04:39:01.642537+0000","last_undegraded":"2024-09-17T04:39:01.642537+0000","last_fullsized":"2024-09-17T04:39:01.642537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:28.082690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642121+0000","last_change":"2024-09-17T04:34:52.069653+0000","last_active":"2024-09-17T04:39:01.642121+0000","last_peered":"2024-09-17T04:39:01.642121+0000","last_clean":"2024-09-17T04:39:01.642121+0000","last_became_active":"2024-09-17T04:34:52.069282+0000","last_became_peered":"2024-09-17T04:34:52.069282+0000","last_unstale":"2024-09-17T04:39:01.642121+0000","last_undegraded":"2024-09-17T04:39:01.642121+0000","last_fullsized":"2024-09-17T04:39:01.642121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:40.828725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.639231+0000","last_change":"2024-09-17T04:34:51.070676+0000","last_active":"2024-09-17T04:39:04.639231+0000","last_peered":"2024-09-17T04:39:04.639231+0000","last_clean":"2024-09-17T04:39:04.639231+0000","last_became_active":"2024-09-17T04:34:51.069006+0000","last_became_peered":"2024-09-17T04:34:51.069006+0000","last_unstale":"2024-09-17T04:39:04.639231+0000","last_undegraded":"2024-09-17T04:39:04.639231+0000","last_fullsized":"2024-09-17T04:39:04.639231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:45.452865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642599+0000","last_change":"2024-09-17T04:34:52.087131+0000","last_active":"2024-09-17T04:39:01.642599+0000","last_peered":"2024-09-17T04:39:01.642599+0000","last_clean":"2024-09-17T04:39:01.642599+0000","last_became_active":"2024-09-17T04:34:52.086782+0000","last_became_peered":"2024-09-17T04:34:52.086782+0000","last_unstale":"2024-09-17T04:39:01.642599+0000","last_undegraded":"2024-09-17T04:39:01.642599+0000","last_fullsized":"2024-09-17T04:39:01.642599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:53.987579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642786+0000","last_change":"2024-09-17T04:34:51.068708+0000","last_active":"2024-09-17T04:39:01.642786+0000","last_peered":"2024-09-17T04:39:01.642786+0000","last_clean":"2024-09-17T04:39:01.642786+0000","last_became_active":"2024-09-17T04:34:51.068354+0000","last_became_peered":"2024-09-17T04:34:51.068354+0000","last_unstale":"2024-09-17T04:39:01.642786+0000","last_undegraded":"2024-09-17T04:39:01.642786+0000","last_fullsized":"2024-09-17T04:39:01.642786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:04.219898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.639204+0000","last_change":"2024-09-17T04:34:52.071586+0000","last_active":"2024-09-17T04:39:04.639204+0000","last_peered":"2024-09-17T04:39:04.639204+0000","last_clean":"2024-09-17T04:39:04.639204+0000","last_became_active":"2024-09-17T04:34:52.071246+0000","last_became_peered":"2024-09-17T04:34:52.071246+0000","last_unstale":"2024-09-17T04:39:04.639204+0000","last_undegraded":"2024-09-17T04:39:04.639204+0000","last_fullsized":"2024-09-17T04:39:04.639204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:03.620107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'12","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640449+0000","last_change":"2024-09-17T04:34:51.078947+0000","last_active":"2024-09-17T04:39:14.640449+0000","last_peered":"2024-09-17T04:39:14.640449+0000","last_clean":"2024-09-17T04:39:14.640449+0000","last_became_active":"2024-09-17T04:34:51.078557+0000","last_became_peered":"2024-09-17T04:34:51.078557+0000","last_unstale":"2024-09-17T04:39:14.640449+0000","last_undegraded":"2024-09-17T04:39:14.640449+0000","last_fullsized":"2024-09-17T04:39:14.640449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:51.413772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640903+0000","last_change":"2024-09-17T04:34:52.086372+0000","last_active":"2024-09-17T04:39:14.640903+0000","last_peered":"2024-09-17T04:39:14.640903+0000","last_clean":"2024-09-17T04:39:14.640903+0000","last_became_active":"2024-09-17T04:34:52.086018+0000","last_became_peered":"2024-09-17T04:34:52.086018+0000","last_unstale":"2024-09-17T04:39:14.640903+0000","last_undegraded":"2024-09-17T04:39:14.640903+0000","last_fullsized":"2024-09-17T04:39:14.640903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:10.818503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:11.643392+0000","last_change":"2024-09-17T04:34:51.076427+0000","last_active":"2024-09-17T04:39:11.643392+0000","last_peered":"2024-09-17T04:39:11.643392+0000","last_clean":"2024-09-17T04:39:11.643392+0000","last_became_active":"2024-09-17T04:34:51.075881+0000","last_became_peered":"2024-09-17T04:34:51.075881+0000","last_unstale":"2024-09-17T04:39:11.643392+0000","last_undegraded":"2024-09-17T04:39:11.643392+0000","last_fullsized":"2024-09-17T04:39:11.643392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:40.903989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.641054+0000","last_change":"2024-09-17T04:34:52.076358+0000","last_active":"2024-09-17T04:39:14.641054+0000","last_peered":"2024-09-17T04:39:14.641054+0000","last_clean":"2024-09-17T04:39:14.641054+0000","last_became_active":"2024-09-17T04:34:52.076035+0000","last_became_peered":"2024-09-17T04:34:52.076035+0000","last_unstale":"2024-09-17T04:39:14.641054+0000","last_undegraded":"2024-09-17T04:39:14.641054+0000","last_fullsized":"2024-09-17T04:39:14.641054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:30.660617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:11.644007+0000","last_change":"2024-09-17T04:34:51.072737+0000","last_active":"2024-09-17T04:39:11.644007+0000","last_peered":"2024-09-17T04:39:11.644007+0000","last_clean":"2024-09-17T04:39:11.644007+0000","last_became_active":"2024-09-17T04:34:51.072378+0000","last_became_peered":"2024-09-17T04:34:51.072378+0000","last_unstale":"2024-09-17T04:39:11.644007+0000","last_undegraded":"2024-09-17T04:39:11.644007+0000","last_fullsized":"2024-09-17T04:39:11.644007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:27.364636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:11.643314+0000","last_change":"2024-09-17T04:34:52.068446+0000","last_active":"2024-09-17T04:39:11.643314+0000","last_peered":"2024-09-17T04:39:11.643314+0000","last_clean":"2024-09-17T04:39:11.643314+0000","last_became_active":"2024-09-17T04:34:52.068047+0000","last_became_peered":"2024-09-17T04:34:52.068047+0000","last_unstale":"2024-09-17T04:39:11.643314+0000","last_undegraded":"2024-09-17T04:39:11.643314+0000","last_fullsized":"2024-09-17T04:39:11.643314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:26.994189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640372+0000","last_change":"2024-09-17T04:34:51.069539+0000","last_active":"2024-09-17T04:39:14.640372+0000","last_peered":"2024-09-17T04:39:14.640372+0000","last_clean":"2024-09-17T04:39:14.640372+0000","last_became_active":"2024-09-17T04:34:51.067438+0000","last_became_peered":"2024-09-17T04:34:51.067438+0000","last_unstale":"2024-09-17T04:39:14.640372+0000","last_undegraded":"2024-09-17T04:39:14.640372+0000","last_fullsized":"2024-09-17T04:39:14.640372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:13.078391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640844+0000","last_change":"2024-09-17T04:34:52.078035+0000","last_active":"2024-09-17T04:39:14.640844+0000","last_peered":"2024-09-17T04:39:14.640844+0000","last_clean":"2024-09-17T04:39:14.640844+0000","last_became_active":"2024-09-17T04:34:52.077708+0000","last_became_peered":"2024-09-17T04:34:52.077708+0000","last_unstale":"2024-09-17T04:39:14.640844+0000","last_undegraded":"2024-09-17T04:39:14.640844+0000","last_fullsized":"2024-09-17T04:39:14.640844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:00.313209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640414+0000","last_change":"2024-09-17T04:34:51.074749+0000","last_active":"2024-09-17T04:39:14.640414+0000","last_peered":"2024-09-17T04:39:14.640414+0000","last_clean":"2024-09-17T04:39:14.640414+0000","last_became_active":"2024-09-17T04:34:51.074393+0000","last_became_peered":"2024-09-17T04:34:51.074393+0000","last_unstale":"2024-09-17T04:39:14.640414+0000","last_undegraded":"2024-09-17T04:39:14.640414+0000","last_fullsized":"2024-09-17T04:39:14.640414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:39.558815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.641915+0000","last_change":"2024-09-17T04:34:52.075585+0000","last_active":"2024-09-17T04:39:24.641915+0000","last_peered":"2024-09-17T04:39:24.641915+0000","last_clean":"2024-09-17T04:39:24.641915+0000","last_became_active":"2024-09-17T04:34:52.075257+0000","last_became_peered":"2024-09-17T04:34:52.075257+0000","last_unstale":"2024-09-17T04:39:24.641915+0000","last_undegraded":"2024-09-17T04:39:24.641915+0000","last_fullsized":"2024-09-17T04:39:24.641915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:38.029256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.645156+0000","last_change":"2024-09-17T04:34:51.071324+0000","last_active":"2024-09-17T04:39:21.645156+0000","last_peered":"2024-09-17T04:39:21.645156+0000","last_clean":"2024-09-17T04:39:21.645156+0000","last_became_active":"2024-09-17T04:34:51.070944+0000","last_became_peered":"2024-09-17T04:34:51.070944+0000","last_unstale":"2024-09-17T04:39:21.645156+0000","last_undegraded":"2024-09-17T04:39:21.645156+0000","last_fullsized":"2024-09-17T04:39:21.645156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:13.931324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:11.643319+0000","last_change":"2024-09-17T04:34:52.081178+0000","last_active":"2024-09-17T04:39:11.643319+0000","last_peered":"2024-09-17T04:39:11.643319+0000","last_clean":"2024-09-17T04:39:11.643319+0000","last_became_active":"2024-09-17T04:34:52.080855+0000","last_became_peered":"2024-09-17T04:34:52.080855+0000","last_unstale":"2024-09-17T04:39:11.643319+0000","last_undegraded":"2024-09-17T04:39:11.643319+0000","last_fullsized":"2024-09-17T04:39:11.643319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:49.091080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.648795+0000","last_change":"2024-09-17T04:34:52.066633+0000","last_active":"2024-09-17T04:39:51.648795+0000","last_peered":"2024-09-17T04:39:51.648795+0000","last_clean":"2024-09-17T04:39:51.648795+0000","last_became_active":"2024-09-17T04:34:52.066263+0000","last_became_peered":"2024-09-17T04:34:52.066263+0000","last_unstale":"2024-09-17T04:39:51.648795+0000","last_undegraded":"2024-09-17T04:39:51.648795+0000","last_fullsized":"2024-09-17T04:39:51.648795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:13.396220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.649018+0000","last_change":"2024-09-17T04:34:51.067927+0000","last_active":"2024-09-17T04:39:51.649018+0000","last_peered":"2024-09-17T04:39:51.649018+0000","last_clean":"2024-09-17T04:39:51.649018+0000","last_became_active":"2024-09-17T04:34:51.067555+0000","last_became_peered":"2024-09-17T04:34:51.067555+0000","last_unstale":"2024-09-17T04:39:51.649018+0000","last_undegraded":"2024-09-17T04:39:51.649018+0000","last_fullsized":"2024-09-17T04:39:51.649018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:33.815585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.648774+0000","last_change":"2024-09-17T04:34:52.074529+0000","last_active":"2024-09-17T04:39:51.648774+0000","last_peered":"2024-09-17T04:39:51.648774+0000","last_clean":"2024-09-17T04:39:51.648774+0000","last_became_active":"2024-09-17T04:34:52.074149+0000","last_became_peered":"2024-09-17T04:34:52.074149+0000","last_unstale":"2024-09-17T04:39:51.648774+0000","last_undegraded":"2024-09-17T04:39:51.648774+0000","last_fullsized":"2024-09-17T04:39:51.648774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:31.679908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.649033+0000","last_change":"2024-09-17T04:34:51.078231+0000","last_active":"2024-09-17T04:39:51.649033+0000","last_peered":"2024-09-17T04:39:51.649033+0000","last_clean":"2024-09-17T04:39:51.649033+0000","last_became_active":"2024-09-17T04:34:51.077872+0000","last_became_peered":"2024-09-17T04:34:51.077872+0000","last_unstale":"2024-09-17T04:39:51.649033+0000","last_undegraded":"2024-09-17T04:39:51.649033+0000","last_fullsized":"2024-09-17T04:39:51.649033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:38.304333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:49.644999+0000","last_change":"2024-09-17T04:35:37.198244+0000","last_active":"2024-09-17T04:39:49.644999+0000","last_peered":"2024-09-17T04:39:49.644999+0000","last_clean":"2024-09-17T04:39:49.644999+0000","last_became_active":"2024-09-17T04:35:37.197990+0000","last_became_peered":"2024-09-17T04:35:37.197990+0000","last_unstale":"2024-09-17T04:39:49.644999+0000","last_undegraded":"2024-09-17T04:39:49.644999+0000","last_fullsized":"2024-09-17T04:39:49.644999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:47:41.801990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:54.638937+0000","last_change":"2024-09-17T04:34:51.073959+0000","last_active":"2024-09-17T04:38:54.638937+0000","last_peered":"2024-09-17T04:38:54.638937+0000","last_clean":"2024-09-17T04:38:54.638937+0000","last_became_active":"2024-09-17T04:34:51.073496+0000","last_became_peered":"2024-09-17T04:34:51.073496+0000","last_unstale":"2024-09-17T04:38:54.638937+0000","last_undegraded":"2024-09-17T04:38:54.638937+0000","last_fullsized":"2024-09-17T04:38:54.638937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:23.001571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:54.638910+0000","last_change":"2024-09-17T04:34:52.081971+0000","last_active":"2024-09-17T04:38:54.638910+0000","last_peered":"2024-09-17T04:38:54.638910+0000","last_clean":"2024-09-17T04:38:54.638910+0000","last_became_active":"2024-09-17T04:34:52.081259+0000","last_became_peered":"2024-09-17T04:34:52.081259+0000","last_unstale":"2024-09-17T04:38:54.638910+0000","last_undegraded":"2024-09-17T04:38:54.638910+0000","last_fullsized":"2024-09-17T04:38:54.638910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:43.915741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.640080+0000","last_change":"2024-09-17T04:34:51.070142+0000","last_active":"2024-09-17T04:39:04.640080+0000","last_peered":"2024-09-17T04:39:04.640080+0000","last_clean":"2024-09-17T04:39:04.640080+0000","last_became_active":"2024-09-17T04:34:51.069777+0000","last_became_peered":"2024-09-17T04:34:51.069777+0000","last_unstale":"2024-09-17T04:39:04.640080+0000","last_undegraded":"2024-09-17T04:39:04.640080+0000","last_fullsized":"2024-09-17T04:39:04.640080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:51.718064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":41308,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":169,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":82616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476833,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":680436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476833,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":126724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476833,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":90130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476833,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":258048,"data_stored":89722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542241,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35640,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336200,"statfs":{"total":96636764160,"available":96600268800,"internally_reserved":0,"allocated":303104,"data_stored":126906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542241,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":89974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542242,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":89696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542242,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":679780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":38154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":37972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:42:32.818 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T04:42:32.818 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:42:32.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.972+0000 7fa72447e640 1 -- 172.21.15.43:0/4241787324 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa71c0ccd60 msgr2=0x7fa71c0ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:32.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.972+0000 7fa72447e640 1 --2- 172.21.15.43:0/4241787324 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa71c0ccd60 0x7fa71c0ce0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa71c0cebc0 tx=0x7fa70c02a970 comp rx=0 tx=0).stop 2024-09-17T04:42:32.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.972+0000 7fa72447e640 1 -- 172.21.15.43:0/4241787324 shutdown_connections 2024-09-17T04:42:32.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.972+0000 7fa72447e640 1 --2- 172.21.15.43:0/4241787324 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa71c0ccd60 0x7fa71c0ce0a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.972+0000 7fa72447e640 1 --2- 172.21.15.43:0/4241787324 >> v2:172.21.15.43:3300/0 conn(0x7fa71c0b4db0 0x7fa71c0caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.972+0000 7fa72447e640 1 -- 172.21.15.43:0/4241787324 >> 172.21.15.43:0/4241787324 conn(0x7fa71c06f4e0 msgr2=0x7fa71c06f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:42:32.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.972+0000 7fa72447e640 1 -- 172.21.15.43:0/4241787324 shutdown_connections 2024-09-17T04:42:32.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.972+0000 7fa72447e640 1 -- 172.21.15.43:0/4241787324 wait complete. 2024-09-17T04:42:32.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.974+0000 7fa72447e640 1 Processor -- start 2024-09-17T04:42:32.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.974+0000 7fa72447e640 1 -- start start 2024-09-17T04:42:32.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.975+0000 7fa72447e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa71c0b4db0 0x7fa71c1563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:32.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.975+0000 7fa72447e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa71c0ccd60 0x7fa71c14c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:32.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.975+0000 7fa72447e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa71c0cd670 0x7fa71c14c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:32.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.975+0000 7fa72447e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c0b5ab0 con 0x7fa71c0b4db0 2024-09-17T04:42:32.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.975+0000 7fa72447e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c0b57d0 con 0x7fa71c0cd670 2024-09-17T04:42:32.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.975+0000 7fa72447e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa71c0cb440 con 0x7fa71c0ccd60 2024-09-17T04:42:32.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.975+0000 7fa72221a640 1 -- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa71c0b4db0 msgr2=0x7fa71c1563d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:3300/0 2024-09-17T04:42:32.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.975+0000 7fa72221a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa71c0b4db0 0x7fa71c1563d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:42:32.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.975+0000 7fa722a1b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa71c0cd670 0x7fa71c14c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:42:32.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.975+0000 7fa721a19640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa71c0ccd60 0x7fa71c14c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:42:32.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.975+0000 7fa722a1b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa71c0cd670 0x7fa71c14c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:39644/0 (socket says 172.21.15.43:39644) 2024-09-17T04:42:32.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.975+0000 7fa721a19640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa71c0ccd60 0x7fa71c14c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:58298/0 (socket says 172.21.15.43:58298) 2024-09-17T04:42:32.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.975+0000 7fa722a1b640 1 -- 172.21.15.43:0/691853215 learned_addr learned my addr 172.21.15.43:0/691853215 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:42:32.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.976+0000 7fa722a1b640 1 -- 172.21.15.43:0/691853215 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa71c0ccd60 msgr2=0x7fa71c14c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:32.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.976+0000 7fa722a1b640 1 --2- 172.21.15.43:0/691853215 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa71c0ccd60 0x7fa71c14c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.976+0000 7fa722a1b640 1 -- 172.21.15.43:0/691853215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa71c0b4db0 msgr2=0x7fa71c1563d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:42:32.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.976+0000 7fa722a1b640 1 --2- 172.21.15.43:0/691853215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa71c0b4db0 0x7fa71c1563d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:32.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.976+0000 7fa722a1b640 1 -- 172.21.15.43:0/691853215 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71c0ca3b0 con 0x7fa71c0cd670 2024-09-17T04:42:32.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.976+0000 7fa722a1b640 1 --2- 172.21.15.43:0/691853215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa71c0cd670 0x7fa71c14c7b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa70c02ae90 tx=0x7fa70c003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:42:32.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.976+0000 7fa71affd640 1 -- 172.21.15.43:0/691853215 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70c034040 con 0x7fa71c0cd670 2024-09-17T04:42:32.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.976+0000 7fa71affd640 1 -- 172.21.15.43:0/691853215 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa70c0046e0 con 0x7fa71c0cd670 2024-09-17T04:42:32.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.976+0000 7fa72447e640 1 -- 172.21.15.43:0/691853215 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa71c154c20 con 0x7fa71c0cd670 2024-09-17T04:42:32.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.976+0000 7fa71affd640 1 -- 172.21.15.43:0/691853215 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70c0456e0 con 0x7fa71c0cd670 2024-09-17T04:42:32.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.976+0000 7fa72447e640 1 -- 172.21.15.43:0/691853215 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa71c154940 con 0x7fa71c0cd670 2024-09-17T04:42:32.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.977+0000 7fa72447e640 1 -- 172.21.15.43:0/691853215 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa71c0b5fd0 con 0x7fa71c0cd670 2024-09-17T04:42:32.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.978+0000 7fa71affd640 1 -- 172.21.15.43:0/691853215 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa70c037020 con 0x7fa71c0cd670 2024-09-17T04:42:32.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.979+0000 7fa71affd640 1 --2- 172.21.15.43:0/691853215 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fa708078b40 0x7fa70807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:32.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.979+0000 7fa71affd640 1 -- 172.21.15.43:0/691853215 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5833+0+0 (secure 0 0 0) 0x7fa70c0bca30 con 0x7fa71c0cd670 2024-09-17T04:42:32.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.979+0000 7fa72221a640 1 --2- 172.21.15.43:0/691853215 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fa708078b40 0x7fa70807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:42:32.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.979+0000 7fa72221a640 1 --2- 172.21.15.43:0/691853215 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fa708078b40 0x7fa70807b050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa714006fd0 tx=0x7fa714006d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:42:32.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:32.983+0000 7fa71affd640 1 -- 172.21.15.43:0/691853215 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa70c084de0 con 0x7fa71c0cd670 2024-09-17T04:42:33.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.164+0000 7fa72447e640 1 -- 172.21.15.43:0/691853215 --> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa71c159220 con 0x7fa708078b40 2024-09-17T04:42:33.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.168+0000 7fa71affd640 1 -- 172.21.15.43:0/691853215 <== mgr.4100 v2:172.21.15.62:6800/1186143747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251982 (secure 0 0 0) 0x7fa71c159220 con 0x7fa708078b40 2024-09-17T04:42:33.171 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:42:33.172 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-17T04:42:33.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.172+0000 7fa72447e640 1 -- 172.21.15.43:0/691853215 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fa708078b40 msgr2=0x7fa70807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:33.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.172+0000 7fa72447e640 1 --2- 172.21.15.43:0/691853215 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fa708078b40 0x7fa70807b050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa714006fd0 tx=0x7fa714006d60 comp rx=0 tx=0).stop 2024-09-17T04:42:33.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.172+0000 7fa72447e640 1 -- 172.21.15.43:0/691853215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa71c0cd670 msgr2=0x7fa71c14c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:33.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.172+0000 7fa72447e640 1 --2- 172.21.15.43:0/691853215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa71c0cd670 0x7fa71c14c7b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa70c02ae90 tx=0x7fa70c003f90 comp rx=0 tx=0).stop 2024-09-17T04:42:33.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.172+0000 7fa72447e640 1 -- 172.21.15.43:0/691853215 shutdown_connections 2024-09-17T04:42:33.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.172+0000 7fa72447e640 1 --2- 172.21.15.43:0/691853215 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7fa708078b40 0x7fa70807b050 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:33.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.172+0000 7fa72447e640 1 --2- 172.21.15.43:0/691853215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa71c0cd670 0x7fa71c14c7b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:33.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.172+0000 7fa72447e640 1 --2- 172.21.15.43:0/691853215 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa71c0ccd60 0x7fa71c14c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:33.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.172+0000 7fa72447e640 1 --2- 172.21.15.43:0/691853215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa71c0b4db0 0x7fa71c1563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:33.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.172+0000 7fa72447e640 1 -- 172.21.15.43:0/691853215 >> 172.21.15.43:0/691853215 conn(0x7fa71c06f4e0 msgr2=0x7fa71c0cb6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:42:33.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.172+0000 7fa72447e640 1 -- 172.21.15.43:0/691853215 shutdown_connections 2024-09-17T04:42:33.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.172+0000 7fa72447e640 1 -- 172.21.15.43:0/691853215 wait complete. 2024-09-17T04:42:33.183 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-09-17T04:42:33.020215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":631990,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":275,"num_write_kb":1732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240280,"kb_used_data":3280,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734440,"statfs":{"total":773094113280,"available":772848066560,"internally_reserved":0,"allocated":3358720,"data_stored":1973368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":314,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003452"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642826+0000","last_change":"2024-09-17T04:34:52.082794+0000","last_active":"2024-09-17T04:39:01.642826+0000","last_peered":"2024-09-17T04:39:01.642826+0000","last_clean":"2024-09-17T04:39:01.642826+0000","last_became_active":"2024-09-17T04:34:52.081216+0000","last_became_peered":"2024-09-17T04:34:52.081216+0000","last_unstale":"2024-09-17T04:39:01.642826+0000","last_undegraded":"2024-09-17T04:39:01.642826+0000","last_fullsized":"2024-09-17T04:39:01.642826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:32.229667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.639259+0000","last_change":"2024-09-17T04:34:52.071762+0000","last_active":"2024-09-17T04:39:04.639259+0000","last_peered":"2024-09-17T04:39:04.639259+0000","last_clean":"2024-09-17T04:39:04.639259+0000","last_became_active":"2024-09-17T04:34:52.071488+0000","last_became_peered":"2024-09-17T04:34:52.071488+0000","last_unstale":"2024-09-17T04:39:04.639259+0000","last_undegraded":"2024-09-17T04:39:04.639259+0000","last_fullsized":"2024-09-17T04:39:04.639259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:00.729921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.640068+0000","last_change":"2024-09-17T04:34:52.073360+0000","last_active":"2024-09-17T04:39:04.640068+0000","last_peered":"2024-09-17T04:39:04.640068+0000","last_clean":"2024-09-17T04:39:04.640068+0000","last_became_active":"2024-09-17T04:34:52.073014+0000","last_became_peered":"2024-09-17T04:34:52.073014+0000","last_unstale":"2024-09-17T04:39:04.640068+0000","last_undegraded":"2024-09-17T04:39:04.640068+0000","last_fullsized":"2024-09-17T04:39:04.640068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:14.331608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"24'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:40:51.655985+0000","last_change":"2024-09-17T04:34:52.077679+0000","last_active":"2024-09-17T04:40:51.655985+0000","last_peered":"2024-09-17T04:40:51.655985+0000","last_clean":"2024-09-17T04:40:51.655985+0000","last_became_active":"2024-09-17T04:34:52.077306+0000","last_became_peered":"2024-09-17T04:34:52.077306+0000","last_unstale":"2024-09-17T04:40:51.655985+0000","last_undegraded":"2024-09-17T04:40:51.655985+0000","last_fullsized":"2024-09-17T04:40:51.655985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:44.967159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"24'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:42:21.667169+0000","last_change":"2024-09-17T04:34:52.075036+0000","last_active":"2024-09-17T04:42:21.667169+0000","last_peered":"2024-09-17T04:42:21.667169+0000","last_clean":"2024-09-17T04:42:21.667169+0000","last_became_active":"2024-09-17T04:34:52.074649+0000","last_became_peered":"2024-09-17T04:34:52.074649+0000","last_unstale":"2024-09-17T04:42:21.667169+0000","last_undegraded":"2024-09-17T04:42:21.667169+0000","last_fullsized":"2024-09-17T04:42:21.667169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:22.293746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"24'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:42:21.666935+0000","last_change":"2024-09-17T04:34:52.081059+0000","last_active":"2024-09-17T04:42:21.666935+0000","last_peered":"2024-09-17T04:42:21.666935+0000","last_clean":"2024-09-17T04:42:21.666935+0000","last_became_active":"2024-09-17T04:34:52.080677+0000","last_became_peered":"2024-09-17T04:34:52.080677+0000","last_unstale":"2024-09-17T04:42:21.666935+0000","last_undegraded":"2024-09-17T04:42:21.666935+0000","last_fullsized":"2024-09-17T04:42:21.666935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:52.404672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.648979+0000","last_change":"2024-09-17T04:34:52.071135+0000","last_active":"2024-09-17T04:39:51.648979+0000","last_peered":"2024-09-17T04:39:51.648979+0000","last_clean":"2024-09-17T04:39:51.648979+0000","last_became_active":"2024-09-17T04:34:52.070844+0000","last_became_peered":"2024-09-17T04:34:52.070844+0000","last_unstale":"2024-09-17T04:39:51.648979+0000","last_undegraded":"2024-09-17T04:39:51.648979+0000","last_fullsized":"2024-09-17T04:39:51.648979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:02.373675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:54.645651+0000","last_change":"2024-09-17T04:34:52.083343+0000","last_active":"2024-09-17T04:39:54.645651+0000","last_peered":"2024-09-17T04:39:54.645651+0000","last_clean":"2024-09-17T04:39:54.645651+0000","last_became_active":"2024-09-17T04:34:52.083008+0000","last_became_peered":"2024-09-17T04:34:52.083008+0000","last_unstale":"2024-09-17T04:39:54.645651+0000","last_undegraded":"2024-09-17T04:39:54.645651+0000","last_fullsized":"2024-09-17T04:39:54.645651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:02.710077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"24'7","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:42:06.665210+0000","last_change":"2024-09-17T04:34:52.083331+0000","last_active":"2024-09-17T04:42:06.665210+0000","last_peered":"2024-09-17T04:42:06.665210+0000","last_clean":"2024-09-17T04:42:06.665210+0000","last_became_active":"2024-09-17T04:34:52.082984+0000","last_became_peered":"2024-09-17T04:34:52.082984+0000","last_unstale":"2024-09-17T04:42:06.665210+0000","last_undegraded":"2024-09-17T04:42:06.665210+0000","last_fullsized":"2024-09-17T04:42:06.665210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:56.779776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"24'3","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:42:31.658310+0000","last_change":"2024-09-17T04:34:52.087207+0000","last_active":"2024-09-17T04:42:31.658310+0000","last_peered":"2024-09-17T04:42:31.658310+0000","last_clean":"2024-09-17T04:42:31.658310+0000","last_became_active":"2024-09-17T04:34:52.086885+0000","last_became_peered":"2024-09-17T04:34:52.086885+0000","last_unstale":"2024-09-17T04:42:31.658310+0000","last_undegraded":"2024-09-17T04:42:31.658310+0000","last_fullsized":"2024-09-17T04:42:31.658310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:52.121338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647093+0000","last_change":"2024-09-17T04:34:52.086309+0000","last_active":"2024-09-17T04:39:41.647093+0000","last_peered":"2024-09-17T04:39:41.647093+0000","last_clean":"2024-09-17T04:39:41.647093+0000","last_became_active":"2024-09-17T04:34:52.085996+0000","last_became_peered":"2024-09-17T04:34:52.085996+0000","last_unstale":"2024-09-17T04:39:41.647093+0000","last_undegraded":"2024-09-17T04:39:41.647093+0000","last_fullsized":"2024-09-17T04:39:41.647093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:58.004980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647237+0000","last_change":"2024-09-17T04:34:52.077080+0000","last_active":"2024-09-17T04:39:41.647237+0000","last_peered":"2024-09-17T04:39:41.647237+0000","last_clean":"2024-09-17T04:39:41.647237+0000","last_became_active":"2024-09-17T04:34:52.076756+0000","last_became_peered":"2024-09-17T04:34:52.076756+0000","last_unstale":"2024-09-17T04:39:41.647237+0000","last_undegraded":"2024-09-17T04:39:41.647237+0000","last_fullsized":"2024-09-17T04:39:41.647237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:48.044400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644400+0000","last_change":"2024-09-17T04:34:52.076609+0000","last_active":"2024-09-17T04:39:44.644400+0000","last_peered":"2024-09-17T04:39:44.644400+0000","last_clean":"2024-09-17T04:39:44.644400+0000","last_became_active":"2024-09-17T04:34:52.076277+0000","last_became_peered":"2024-09-17T04:34:52.076277+0000","last_unstale":"2024-09-17T04:39:44.644400+0000","last_undegraded":"2024-09-17T04:39:44.644400+0000","last_fullsized":"2024-09-17T04:39:44.644400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:28.537566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'3","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.643368+0000","last_change":"2024-09-17T04:34:52.076754+0000","last_active":"2024-09-17T04:39:34.643368+0000","last_peered":"2024-09-17T04:39:34.643368+0000","last_clean":"2024-09-17T04:39:34.643368+0000","last_became_active":"2024-09-17T04:34:52.076261+0000","last_became_peered":"2024-09-17T04:34:52.076261+0000","last_unstale":"2024-09-17T04:39:34.643368+0000","last_undegraded":"2024-09-17T04:39:34.643368+0000","last_fullsized":"2024-09-17T04:39:34.643368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:51.359116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.642967+0000","last_change":"2024-09-17T04:34:52.079161+0000","last_active":"2024-09-17T04:39:34.642967+0000","last_peered":"2024-09-17T04:39:34.642967+0000","last_clean":"2024-09-17T04:39:34.642967+0000","last_became_active":"2024-09-17T04:34:52.078782+0000","last_became_peered":"2024-09-17T04:34:52.078782+0000","last_unstale":"2024-09-17T04:39:34.642967+0000","last_undegraded":"2024-09-17T04:39:34.642967+0000","last_fullsized":"2024-09-17T04:39:34.642967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:06.894137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"24'4","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:42:31.661246+0000","last_change":"2024-09-17T04:34:52.070767+0000","last_active":"2024-09-17T04:42:31.661246+0000","last_peered":"2024-09-17T04:42:31.661246+0000","last_clean":"2024-09-17T04:42:31.661246+0000","last_became_active":"2024-09-17T04:34:52.070428+0000","last_became_peered":"2024-09-17T04:34:52.070428+0000","last_unstale":"2024-09-17T04:42:31.661246+0000","last_undegraded":"2024-09-17T04:42:31.661246+0000","last_fullsized":"2024-09-17T04:42:31.661246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:42.820391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"24'5","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:41:51.663214+0000","last_change":"2024-09-17T04:34:52.077238+0000","last_active":"2024-09-17T04:41:51.663214+0000","last_peered":"2024-09-17T04:41:51.663214+0000","last_clean":"2024-09-17T04:41:51.663214+0000","last_became_active":"2024-09-17T04:34:52.076897+0000","last_became_peered":"2024-09-17T04:34:52.076897+0000","last_unstale":"2024-09-17T04:41:51.663214+0000","last_undegraded":"2024-09-17T04:41:51.663214+0000","last_fullsized":"2024-09-17T04:41:51.663214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:27.431184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.643014+0000","last_change":"2024-09-17T04:34:52.080917+0000","last_active":"2024-09-17T04:39:34.643014+0000","last_peered":"2024-09-17T04:39:34.643014+0000","last_clean":"2024-09-17T04:39:34.643014+0000","last_became_active":"2024-09-17T04:34:52.080597+0000","last_became_peered":"2024-09-17T04:34:52.080597+0000","last_unstale":"2024-09-17T04:39:34.643014+0000","last_undegraded":"2024-09-17T04:39:34.643014+0000","last_fullsized":"2024-09-17T04:39:34.643014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:10.560075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"24'6","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:41:36.661817+0000","last_change":"2024-09-17T04:34:52.077284+0000","last_active":"2024-09-17T04:41:36.661817+0000","last_peered":"2024-09-17T04:41:36.661817+0000","last_clean":"2024-09-17T04:41:36.661817+0000","last_became_active":"2024-09-17T04:34:52.076950+0000","last_became_peered":"2024-09-17T04:34:52.076950+0000","last_unstale":"2024-09-17T04:41:36.661817+0000","last_undegraded":"2024-09-17T04:41:36.661817+0000","last_fullsized":"2024-09-17T04:41:36.661817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:06.361530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"24'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:42:31.661792+0000","last_change":"2024-09-17T04:34:52.083859+0000","last_active":"2024-09-17T04:42:31.661792+0000","last_peered":"2024-09-17T04:42:31.661792+0000","last_clean":"2024-09-17T04:42:31.661792+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:42:31.661792+0000","last_undegraded":"2024-09-17T04:42:31.661792+0000","last_fullsized":"2024-09-17T04:42:31.661792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:25.262925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.642080+0000","last_change":"2024-09-17T04:34:52.086460+0000","last_active":"2024-09-17T04:39:24.642080+0000","last_peered":"2024-09-17T04:39:24.642080+0000","last_clean":"2024-09-17T04:39:24.642080+0000","last_became_active":"2024-09-17T04:34:52.084848+0000","last_became_peered":"2024-09-17T04:34:52.084848+0000","last_unstale":"2024-09-17T04:39:24.642080+0000","last_undegraded":"2024-09-17T04:39:24.642080+0000","last_fullsized":"2024-09-17T04:39:24.642080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:22.927331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.644942+0000","last_change":"2024-09-17T04:34:52.080149+0000","last_active":"2024-09-17T04:39:21.644942+0000","last_peered":"2024-09-17T04:39:21.644942+0000","last_clean":"2024-09-17T04:39:21.644942+0000","last_became_active":"2024-09-17T04:34:52.079490+0000","last_became_peered":"2024-09-17T04:34:52.079490+0000","last_unstale":"2024-09-17T04:39:21.644942+0000","last_undegraded":"2024-09-17T04:39:21.644942+0000","last_fullsized":"2024-09-17T04:39:21.644942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:52.314715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.641891+0000","last_change":"2024-09-17T04:34:52.082765+0000","last_active":"2024-09-17T04:39:24.641891+0000","last_peered":"2024-09-17T04:39:24.641891+0000","last_clean":"2024-09-17T04:39:24.641891+0000","last_became_active":"2024-09-17T04:34:52.081049+0000","last_became_peered":"2024-09-17T04:34:52.081049+0000","last_unstale":"2024-09-17T04:39:24.641891+0000","last_undegraded":"2024-09-17T04:39:24.641891+0000","last_fullsized":"2024-09-17T04:39:24.641891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.762553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:11.643792+0000","last_change":"2024-09-17T04:34:52.086233+0000","last_active":"2024-09-17T04:39:11.643792+0000","last_peered":"2024-09-17T04:39:11.643792+0000","last_clean":"2024-09-17T04:39:11.643792+0000","last_became_active":"2024-09-17T04:34:52.085876+0000","last_became_peered":"2024-09-17T04:34:52.085876+0000","last_unstale":"2024-09-17T04:39:11.643792+0000","last_undegraded":"2024-09-17T04:39:11.643792+0000","last_fullsized":"2024-09-17T04:39:11.643792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:44.061677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640892+0000","last_change":"2024-09-17T04:34:52.079305+0000","last_active":"2024-09-17T04:39:14.640892+0000","last_peered":"2024-09-17T04:39:14.640892+0000","last_clean":"2024-09-17T04:39:14.640892+0000","last_became_active":"2024-09-17T04:34:52.078984+0000","last_became_peered":"2024-09-17T04:34:52.078984+0000","last_unstale":"2024-09-17T04:39:14.640892+0000","last_undegraded":"2024-09-17T04:39:14.640892+0000","last_fullsized":"2024-09-17T04:39:14.640892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:15.927488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"24'6","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:42:31.656651+0000","last_change":"2024-09-17T04:34:52.077495+0000","last_active":"2024-09-17T04:42:31.656651+0000","last_peered":"2024-09-17T04:42:31.656651+0000","last_clean":"2024-09-17T04:42:31.656651+0000","last_became_active":"2024-09-17T04:34:52.077167+0000","last_became_peered":"2024-09-17T04:34:52.077167+0000","last_unstale":"2024-09-17T04:42:31.656651+0000","last_undegraded":"2024-09-17T04:42:31.656651+0000","last_fullsized":"2024-09-17T04:42:31.656651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.411611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640431+0000","last_change":"2024-09-17T04:34:52.077389+0000","last_active":"2024-09-17T04:39:14.640431+0000","last_peered":"2024-09-17T04:39:14.640431+0000","last_clean":"2024-09-17T04:39:14.640431+0000","last_became_active":"2024-09-17T04:34:52.076993+0000","last_became_peered":"2024-09-17T04:34:52.076993+0000","last_unstale":"2024-09-17T04:39:14.640431+0000","last_undegraded":"2024-09-17T04:39:14.640431+0000","last_fullsized":"2024-09-17T04:39:14.640431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:18.540098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640877+0000","last_change":"2024-09-17T04:34:52.080545+0000","last_active":"2024-09-17T04:39:14.640877+0000","last_peered":"2024-09-17T04:39:14.640877+0000","last_clean":"2024-09-17T04:39:14.640877+0000","last_became_active":"2024-09-17T04:34:52.079930+0000","last_became_peered":"2024-09-17T04:34:52.079930+0000","last_unstale":"2024-09-17T04:39:14.640877+0000","last_undegraded":"2024-09-17T04:39:14.640877+0000","last_fullsized":"2024-09-17T04:39:14.640877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:50.491050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.640051+0000","last_change":"2024-09-17T04:34:52.083598+0000","last_active":"2024-09-17T04:39:04.640051+0000","last_peered":"2024-09-17T04:39:04.640051+0000","last_clean":"2024-09-17T04:39:04.640051+0000","last_became_active":"2024-09-17T04:34:52.083225+0000","last_became_peered":"2024-09-17T04:34:52.083225+0000","last_unstale":"2024-09-17T04:39:04.640051+0000","last_undegraded":"2024-09-17T04:39:04.640051+0000","last_fullsized":"2024-09-17T04:39:04.640051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:22.713546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:49.644963+0000","last_change":"2024-09-17T04:35:37.193329+0000","last_active":"2024-09-17T04:39:49.644963+0000","last_peered":"2024-09-17T04:39:49.644963+0000","last_clean":"2024-09-17T04:39:49.644963+0000","last_became_active":"2024-09-17T04:35:37.192946+0000","last_became_peered":"2024-09-17T04:35:37.192946+0000","last_unstale":"2024-09-17T04:39:49.644963+0000","last_undegraded":"2024-09-17T04:39:49.644963+0000","last_fullsized":"2024-09-17T04:39:49.644963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:08.179268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.639160+0000","last_change":"2024-09-17T04:34:52.082113+0000","last_active":"2024-09-17T04:39:04.639160+0000","last_peered":"2024-09-17T04:39:04.639160+0000","last_clean":"2024-09-17T04:39:04.639160+0000","last_became_active":"2024-09-17T04:34:52.081762+0000","last_became_peered":"2024-09-17T04:34:52.081762+0000","last_unstale":"2024-09-17T04:39:04.639160+0000","last_undegraded":"2024-09-17T04:39:04.639160+0000","last_fullsized":"2024-09-17T04:39:04.639160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:52.744564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"24'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:41:06.657429+0000","last_change":"2024-09-17T04:34:52.083306+0000","last_active":"2024-09-17T04:41:06.657429+0000","last_peered":"2024-09-17T04:41:06.657429+0000","last_clean":"2024-09-17T04:41:06.657429+0000","last_became_active":"2024-09-17T04:34:52.082590+0000","last_became_peered":"2024-09-17T04:34:52.082590+0000","last_unstale":"2024-09-17T04:41:06.657429+0000","last_undegraded":"2024-09-17T04:41:06.657429+0000","last_fullsized":"2024-09-17T04:41:06.657429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:21.022403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"24'5","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:42:31.666349+0000","last_change":"2024-09-17T04:34:52.070155+0000","last_active":"2024-09-17T04:42:31.666349+0000","last_peered":"2024-09-17T04:42:31.666349+0000","last_clean":"2024-09-17T04:42:31.666349+0000","last_became_active":"2024-09-17T04:34:52.069498+0000","last_became_peered":"2024-09-17T04:34:52.069498+0000","last_unstale":"2024-09-17T04:42:31.666349+0000","last_undegraded":"2024-09-17T04:42:31.666349+0000","last_fullsized":"2024-09-17T04:42:31.666349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:24.539277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:54.645708+0000","last_change":"2024-09-17T04:34:51.074188+0000","last_active":"2024-09-17T04:39:54.645708+0000","last_peered":"2024-09-17T04:39:54.645708+0000","last_clean":"2024-09-17T04:39:54.645708+0000","last_became_active":"2024-09-17T04:34:51.073740+0000","last_became_peered":"2024-09-17T04:34:51.073740+0000","last_unstale":"2024-09-17T04:39:54.645708+0000","last_undegraded":"2024-09-17T04:39:54.645708+0000","last_fullsized":"2024-09-17T04:39:54.645708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:36.692687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:54.645926+0000","last_change":"2024-09-17T04:34:52.081048+0000","last_active":"2024-09-17T04:39:54.645926+0000","last_peered":"2024-09-17T04:39:54.645926+0000","last_clean":"2024-09-17T04:39:54.645926+0000","last_became_active":"2024-09-17T04:34:52.080703+0000","last_became_peered":"2024-09-17T04:34:52.080703+0000","last_unstale":"2024-09-17T04:39:54.645926+0000","last_undegraded":"2024-09-17T04:39:54.645926+0000","last_fullsized":"2024-09-17T04:39:54.645926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:05.164849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.648336+0000","last_change":"2024-09-17T04:34:51.078602+0000","last_active":"2024-09-17T04:39:51.648336+0000","last_peered":"2024-09-17T04:39:51.648336+0000","last_clean":"2024-09-17T04:39:51.648336+0000","last_became_active":"2024-09-17T04:34:51.078221+0000","last_became_peered":"2024-09-17T04:34:51.078221+0000","last_unstale":"2024-09-17T04:39:51.648336+0000","last_undegraded":"2024-09-17T04:39:51.648336+0000","last_fullsized":"2024-09-17T04:39:51.648336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:59.716216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644377+0000","last_change":"2024-09-17T04:34:51.077573+0000","last_active":"2024-09-17T04:39:44.644377+0000","last_peered":"2024-09-17T04:39:44.644377+0000","last_clean":"2024-09-17T04:39:44.644377+0000","last_became_active":"2024-09-17T04:34:51.077225+0000","last_became_peered":"2024-09-17T04:34:51.077225+0000","last_unstale":"2024-09-17T04:39:44.644377+0000","last_undegraded":"2024-09-17T04:39:44.644377+0000","last_fullsized":"2024-09-17T04:39:44.644377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:29.348927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644335+0000","last_change":"2024-09-17T04:34:52.074356+0000","last_active":"2024-09-17T04:39:44.644335+0000","last_peered":"2024-09-17T04:39:44.644335+0000","last_clean":"2024-09-17T04:39:44.644335+0000","last_became_active":"2024-09-17T04:34:52.072796+0000","last_became_peered":"2024-09-17T04:34:52.072796+0000","last_unstale":"2024-09-17T04:39:44.644335+0000","last_undegraded":"2024-09-17T04:39:44.644335+0000","last_fullsized":"2024-09-17T04:39:44.644335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:53.971839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647411+0000","last_change":"2024-09-17T04:34:51.074170+0000","last_active":"2024-09-17T04:39:41.647411+0000","last_peered":"2024-09-17T04:39:41.647411+0000","last_clean":"2024-09-17T04:39:41.647411+0000","last_became_active":"2024-09-17T04:34:51.073836+0000","last_became_peered":"2024-09-17T04:34:51.073836+0000","last_unstale":"2024-09-17T04:39:41.647411+0000","last_undegraded":"2024-09-17T04:39:41.647411+0000","last_fullsized":"2024-09-17T04:39:41.647411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:30.884002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644326+0000","last_change":"2024-09-17T04:34:52.078331+0000","last_active":"2024-09-17T04:39:44.644326+0000","last_peered":"2024-09-17T04:39:44.644326+0000","last_clean":"2024-09-17T04:39:44.644326+0000","last_became_active":"2024-09-17T04:34:52.078012+0000","last_became_peered":"2024-09-17T04:34:52.078012+0000","last_unstale":"2024-09-17T04:39:44.644326+0000","last_undegraded":"2024-09-17T04:39:44.644326+0000","last_fullsized":"2024-09-17T04:39:44.644326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:28.961571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647134+0000","last_change":"2024-09-17T04:34:51.077676+0000","last_active":"2024-09-17T04:39:41.647134+0000","last_peered":"2024-09-17T04:39:41.647134+0000","last_clean":"2024-09-17T04:39:41.647134+0000","last_became_active":"2024-09-17T04:34:51.076291+0000","last_became_peered":"2024-09-17T04:34:51.076291+0000","last_unstale":"2024-09-17T04:39:41.647134+0000","last_undegraded":"2024-09-17T04:39:41.647134+0000","last_fullsized":"2024-09-17T04:39:41.647134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:42.622688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:04.631764+0000","last_change":"2024-09-17T04:35:37.194320+0000","last_active":"2024-09-17T04:38:04.631764+0000","last_peered":"2024-09-17T04:38:04.631764+0000","last_clean":"2024-09-17T04:38:04.631764+0000","last_became_active":"2024-09-17T04:35:37.193979+0000","last_became_peered":"2024-09-17T04:35:37.193979+0000","last_unstale":"2024-09-17T04:38:04.631764+0000","last_undegraded":"2024-09-17T04:38:04.631764+0000","last_fullsized":"2024-09-17T04:38:04.631764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:17.056823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:41.647472+0000","last_change":"2024-09-17T04:34:51.077199+0000","last_active":"2024-09-17T04:39:41.647472+0000","last_peered":"2024-09-17T04:39:41.647472+0000","last_clean":"2024-09-17T04:39:41.647472+0000","last_became_active":"2024-09-17T04:34:51.076867+0000","last_became_peered":"2024-09-17T04:34:51.076867+0000","last_unstale":"2024-09-17T04:39:41.647472+0000","last_undegraded":"2024-09-17T04:39:41.647472+0000","last_fullsized":"2024-09-17T04:39:41.647472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:09.194133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644651+0000","last_change":"2024-09-17T04:34:52.083401+0000","last_active":"2024-09-17T04:39:44.644651+0000","last_peered":"2024-09-17T04:39:44.644651+0000","last_clean":"2024-09-17T04:39:44.644651+0000","last_became_active":"2024-09-17T04:34:52.083086+0000","last_became_peered":"2024-09-17T04:34:52.083086+0000","last_unstale":"2024-09-17T04:39:44.644651+0000","last_undegraded":"2024-09-17T04:39:44.644651+0000","last_fullsized":"2024-09-17T04:39:44.644651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:08.237945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'7","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:44.644384+0000","last_change":"2024-09-17T04:34:51.070235+0000","last_active":"2024-09-17T04:39:44.644384+0000","last_peered":"2024-09-17T04:39:44.644384+0000","last_clean":"2024-09-17T04:39:44.644384+0000","last_became_active":"2024-09-17T04:34:51.069278+0000","last_became_peered":"2024-09-17T04:34:51.069278+0000","last_unstale":"2024-09-17T04:39:44.644384+0000","last_undegraded":"2024-09-17T04:39:44.644384+0000","last_fullsized":"2024-09-17T04:39:44.644384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:55.959278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:41:51.662623+0000","last_change":"2024-09-17T04:34:52.076233+0000","last_active":"2024-09-17T04:41:51.662623+0000","last_peered":"2024-09-17T04:41:51.662623+0000","last_clean":"2024-09-17T04:41:51.662623+0000","last_became_active":"2024-09-17T04:34:52.075682+0000","last_became_peered":"2024-09-17T04:34:52.075682+0000","last_unstale":"2024-09-17T04:41:51.662623+0000","last_undegraded":"2024-09-17T04:41:51.662623+0000","last_fullsized":"2024-09-17T04:41:51.662623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:22.047574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'27","reported_seq":49,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:42:31.642033+0000","last_change":"2024-09-17T04:34:51.076416+0000","last_active":"2024-09-17T04:42:31.642033+0000","last_peered":"2024-09-17T04:42:31.642033+0000","last_clean":"2024-09-17T04:42:31.642033+0000","last_became_active":"2024-09-17T04:34:51.076051+0000","last_became_peered":"2024-09-17T04:34:51.076051+0000","last_unstale":"2024-09-17T04:42:31.642033+0000","last_undegraded":"2024-09-17T04:42:31.642033+0000","last_fullsized":"2024-09-17T04:42:31.642033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:52.255204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37211,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"24'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:42:06.665176+0000","last_change":"2024-09-17T04:34:52.086230+0000","last_active":"2024-09-17T04:42:06.665176+0000","last_peered":"2024-09-17T04:42:06.665176+0000","last_clean":"2024-09-17T04:42:06.665176+0000","last_became_active":"2024-09-17T04:34:52.085910+0000","last_became_peered":"2024-09-17T04:34:52.085910+0000","last_unstale":"2024-09-17T04:42:06.665176+0000","last_undegraded":"2024-09-17T04:42:06.665176+0000","last_fullsized":"2024-09-17T04:42:06.665176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:36.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.643405+0000","last_change":"2024-09-17T04:34:51.075224+0000","last_active":"2024-09-17T04:39:34.643405+0000","last_peered":"2024-09-17T04:39:34.643405+0000","last_clean":"2024-09-17T04:39:34.643405+0000","last_became_active":"2024-09-17T04:34:51.074912+0000","last_became_peered":"2024-09-17T04:34:51.074912+0000","last_unstale":"2024-09-17T04:39:34.643405+0000","last_undegraded":"2024-09-17T04:39:34.643405+0000","last_fullsized":"2024-09-17T04:39:34.643405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:33.811243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.643389+0000","last_change":"2024-09-17T04:34:52.085906+0000","last_active":"2024-09-17T04:39:34.643389+0000","last_peered":"2024-09-17T04:39:34.643389+0000","last_clean":"2024-09-17T04:39:34.643389+0000","last_became_active":"2024-09-17T04:34:52.085538+0000","last_became_peered":"2024-09-17T04:34:52.085538+0000","last_unstale":"2024-09-17T04:39:34.643389+0000","last_undegraded":"2024-09-17T04:39:34.643389+0000","last_fullsized":"2024-09-17T04:39:34.643389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:21.997395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:31.646079+0000","last_change":"2024-09-17T04:34:51.074253+0000","last_active":"2024-09-17T04:39:31.646079+0000","last_peered":"2024-09-17T04:39:31.646079+0000","last_clean":"2024-09-17T04:39:31.646079+0000","last_became_active":"2024-09-17T04:34:51.073812+0000","last_became_peered":"2024-09-17T04:34:51.073812+0000","last_unstale":"2024-09-17T04:39:31.646079+0000","last_undegraded":"2024-09-17T04:39:31.646079+0000","last_fullsized":"2024-09-17T04:39:31.646079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:38.971561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:41:51.663605+0000","last_change":"2024-09-17T04:34:52.082137+0000","last_active":"2024-09-17T04:41:51.663605+0000","last_peered":"2024-09-17T04:41:51.663605+0000","last_clean":"2024-09-17T04:41:51.663605+0000","last_became_active":"2024-09-17T04:34:52.081775+0000","last_became_peered":"2024-09-17T04:34:52.081775+0000","last_unstale":"2024-09-17T04:41:51.663605+0000","last_undegraded":"2024-09-17T04:41:51.663605+0000","last_fullsized":"2024-09-17T04:41:51.663605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:57.911822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"24'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:41:51.662619+0000","last_change":"2024-09-17T04:34:51.077157+0000","last_active":"2024-09-17T04:41:51.662619+0000","last_peered":"2024-09-17T04:41:51.662619+0000","last_clean":"2024-09-17T04:41:51.662619+0000","last_became_active":"2024-09-17T04:34:51.076797+0000","last_became_peered":"2024-09-17T04:34:51.076797+0000","last_unstale":"2024-09-17T04:41:51.662619+0000","last_undegraded":"2024-09-17T04:41:51.662619+0000","last_fullsized":"2024-09-17T04:41:51.662619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:20.118978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":985,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"24'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:41:51.662593+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:41:51.662593+0000","last_peered":"2024-09-17T04:41:51.662593+0000","last_clean":"2024-09-17T04:41:51.662593+0000","last_became_active":"2024-09-17T04:34:52.082118+0000","last_became_peered":"2024-09-17T04:34:52.082118+0000","last_unstale":"2024-09-17T04:41:51.662593+0000","last_undegraded":"2024-09-17T04:41:51.662593+0000","last_fullsized":"2024-09-17T04:41:51.662593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:44.752945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'16","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:34.642945+0000","last_change":"2024-09-17T04:34:51.071083+0000","last_active":"2024-09-17T04:39:34.642945+0000","last_peered":"2024-09-17T04:39:34.642945+0000","last_clean":"2024-09-17T04:39:34.642945+0000","last_became_active":"2024-09-17T04:34:51.070733+0000","last_became_peered":"2024-09-17T04:34:51.070733+0000","last_unstale":"2024-09-17T04:39:34.642945+0000","last_undegraded":"2024-09-17T04:39:34.642945+0000","last_fullsized":"2024-09-17T04:39:34.642945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:36.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"24'3","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:41:51.663565+0000","last_change":"2024-09-17T04:34:52.080277+0000","last_active":"2024-09-17T04:41:51.663565+0000","last_peered":"2024-09-17T04:41:51.663565+0000","last_clean":"2024-09-17T04:41:51.663565+0000","last_became_active":"2024-09-17T04:34:52.079969+0000","last_became_peered":"2024-09-17T04:34:52.079969+0000","last_unstale":"2024-09-17T04:41:51.663565+0000","last_undegraded":"2024-09-17T04:41:51.663565+0000","last_fullsized":"2024-09-17T04:41:51.663565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:10.360905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.644561+0000","last_change":"2024-09-17T04:34:51.074800+0000","last_active":"2024-09-17T04:39:21.644561+0000","last_peered":"2024-09-17T04:39:21.644561+0000","last_clean":"2024-09-17T04:39:21.644561+0000","last_became_active":"2024-09-17T04:34:51.073287+0000","last_became_peered":"2024-09-17T04:34:51.073287+0000","last_unstale":"2024-09-17T04:39:21.644561+0000","last_undegraded":"2024-09-17T04:39:21.644561+0000","last_fullsized":"2024-09-17T04:39:21.644561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:19.933857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.645232+0000","last_change":"2024-09-17T04:34:52.082951+0000","last_active":"2024-09-17T04:39:21.645232+0000","last_peered":"2024-09-17T04:39:21.645232+0000","last_clean":"2024-09-17T04:39:21.645232+0000","last_became_active":"2024-09-17T04:34:52.082607+0000","last_became_peered":"2024-09-17T04:34:52.082607+0000","last_unstale":"2024-09-17T04:39:21.645232+0000","last_undegraded":"2024-09-17T04:39:21.645232+0000","last_fullsized":"2024-09-17T04:39:21.645232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:08.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.641560+0000","last_change":"2024-09-17T04:34:51.077171+0000","last_active":"2024-09-17T04:39:24.641560+0000","last_peered":"2024-09-17T04:39:24.641560+0000","last_clean":"2024-09-17T04:39:24.641560+0000","last_became_active":"2024-09-17T04:34:51.076780+0000","last_became_peered":"2024-09-17T04:34:51.076780+0000","last_unstale":"2024-09-17T04:39:24.641560+0000","last_undegraded":"2024-09-17T04:39:24.641560+0000","last_fullsized":"2024-09-17T04:39:24.641560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:40.031852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'5","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:42:31.668306+0000","last_change":"2024-09-17T04:34:52.080032+0000","last_active":"2024-09-17T04:42:31.668306+0000","last_peered":"2024-09-17T04:42:31.668306+0000","last_clean":"2024-09-17T04:42:31.668306+0000","last_became_active":"2024-09-17T04:34:52.079536+0000","last_became_peered":"2024-09-17T04:34:52.079536+0000","last_unstale":"2024-09-17T04:42:31.668306+0000","last_undegraded":"2024-09-17T04:42:31.668306+0000","last_fullsized":"2024-09-17T04:42:31.668306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:55.220027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.641570+0000","last_change":"2024-09-17T04:34:51.071053+0000","last_active":"2024-09-17T04:39:24.641570+0000","last_peered":"2024-09-17T04:39:24.641570+0000","last_clean":"2024-09-17T04:39:24.641570+0000","last_became_active":"2024-09-17T04:34:51.070673+0000","last_became_peered":"2024-09-17T04:34:51.070673+0000","last_unstale":"2024-09-17T04:39:24.641570+0000","last_undegraded":"2024-09-17T04:39:24.641570+0000","last_fullsized":"2024-09-17T04:39:24.641570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:31.660200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.644973+0000","last_change":"2024-09-17T04:34:52.077963+0000","last_active":"2024-09-17T04:39:21.644973+0000","last_peered":"2024-09-17T04:39:21.644973+0000","last_clean":"2024-09-17T04:39:21.644973+0000","last_became_active":"2024-09-17T04:34:52.077499+0000","last_became_peered":"2024-09-17T04:34:52.077499+0000","last_unstale":"2024-09-17T04:39:21.644973+0000","last_undegraded":"2024-09-17T04:39:21.644973+0000","last_fullsized":"2024-09-17T04:39:21.644973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:25.309696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.641526+0000","last_change":"2024-09-17T04:34:51.070532+0000","last_active":"2024-09-17T04:39:24.641526+0000","last_peered":"2024-09-17T04:39:24.641526+0000","last_clean":"2024-09-17T04:39:24.641526+0000","last_became_active":"2024-09-17T04:34:51.070179+0000","last_became_peered":"2024-09-17T04:34:51.070179+0000","last_unstale":"2024-09-17T04:39:24.641526+0000","last_undegraded":"2024-09-17T04:39:24.641526+0000","last_fullsized":"2024-09-17T04:39:24.641526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:52.027096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'5","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:42:31.667188+0000","last_change":"2024-09-17T04:34:52.083159+0000","last_active":"2024-09-17T04:42:31.667188+0000","last_peered":"2024-09-17T04:42:31.667188+0000","last_clean":"2024-09-17T04:42:31.667188+0000","last_became_active":"2024-09-17T04:34:52.082847+0000","last_became_peered":"2024-09-17T04:34:52.082847+0000","last_unstale":"2024-09-17T04:42:31.667188+0000","last_undegraded":"2024-09-17T04:42:31.667188+0000","last_fullsized":"2024-09-17T04:42:31.667188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:25.210506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:41.640327+0000","last_change":"2024-09-17T04:34:41.975789+0000","last_active":"2024-09-17T04:38:41.640327+0000","last_peered":"2024-09-17T04:38:41.640327+0000","last_clean":"2024-09-17T04:38:41.640327+0000","last_became_active":"2024-09-17T04:34:41.974664+0000","last_became_peered":"2024-09-17T04:34:41.974664+0000","last_unstale":"2024-09-17T04:38:41.640327+0000","last_undegraded":"2024-09-17T04:38:41.640327+0000","last_fullsized":"2024-09-17T04:38:41.640327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:39.702713+0000","last_clean_scrub_stamp":"2024-09-17T04:34:39.702713+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:30.302931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642564+0000","last_change":"2024-09-17T04:34:51.068782+0000","last_active":"2024-09-17T04:39:01.642564+0000","last_peered":"2024-09-17T04:39:01.642564+0000","last_clean":"2024-09-17T04:39:01.642564+0000","last_became_active":"2024-09-17T04:34:51.068375+0000","last_became_peered":"2024-09-17T04:34:51.068375+0000","last_unstale":"2024-09-17T04:39:01.642564+0000","last_undegraded":"2024-09-17T04:39:01.642564+0000","last_fullsized":"2024-09-17T04:39:01.642564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:25.307166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:49.644929+0000","last_change":"2024-09-17T04:35:37.196118+0000","last_active":"2024-09-17T04:39:49.644929+0000","last_peered":"2024-09-17T04:39:49.644929+0000","last_clean":"2024-09-17T04:39:49.644929+0000","last_became_active":"2024-09-17T04:35:37.195780+0000","last_became_peered":"2024-09-17T04:35:37.195780+0000","last_unstale":"2024-09-17T04:39:49.644929+0000","last_undegraded":"2024-09-17T04:39:49.644929+0000","last_fullsized":"2024-09-17T04:39:49.644929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:48.569400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:51.641567+0000","last_change":"2024-09-17T04:34:51.075655+0000","last_active":"2024-09-17T04:38:51.641567+0000","last_peered":"2024-09-17T04:38:51.641567+0000","last_clean":"2024-09-17T04:38:51.641567+0000","last_became_active":"2024-09-17T04:34:51.075313+0000","last_became_peered":"2024-09-17T04:34:51.075313+0000","last_unstale":"2024-09-17T04:38:51.641567+0000","last_undegraded":"2024-09-17T04:38:51.641567+0000","last_fullsized":"2024-09-17T04:38:51.641567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:47.853850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.640022+0000","last_change":"2024-09-17T04:34:52.080065+0000","last_active":"2024-09-17T04:39:04.640022+0000","last_peered":"2024-09-17T04:39:04.640022+0000","last_clean":"2024-09-17T04:39:04.640022+0000","last_became_active":"2024-09-17T04:34:52.079672+0000","last_became_peered":"2024-09-17T04:34:52.079672+0000","last_unstale":"2024-09-17T04:39:04.640022+0000","last_undegraded":"2024-09-17T04:39:04.640022+0000","last_fullsized":"2024-09-17T04:39:04.640022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:52.040153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"24'8","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.639201+0000","last_change":"2024-09-17T04:34:51.075960+0000","last_active":"2024-09-17T04:39:04.639201+0000","last_peered":"2024-09-17T04:39:04.639201+0000","last_clean":"2024-09-17T04:39:04.639201+0000","last_became_active":"2024-09-17T04:34:51.075561+0000","last_became_peered":"2024-09-17T04:34:51.075561+0000","last_unstale":"2024-09-17T04:39:04.639201+0000","last_undegraded":"2024-09-17T04:39:04.639201+0000","last_fullsized":"2024-09-17T04:39:04.639201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:44.834618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:54.637775+0000","last_change":"2024-09-17T04:34:52.070068+0000","last_active":"2024-09-17T04:38:54.637775+0000","last_peered":"2024-09-17T04:38:54.637775+0000","last_clean":"2024-09-17T04:38:54.637775+0000","last_became_active":"2024-09-17T04:34:52.069669+0000","last_became_peered":"2024-09-17T04:34:52.069669+0000","last_unstale":"2024-09-17T04:38:54.637775+0000","last_undegraded":"2024-09-17T04:38:54.637775+0000","last_fullsized":"2024-09-17T04:38:54.637775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:39.617045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642537+0000","last_change":"2024-09-17T04:34:51.070187+0000","last_active":"2024-09-17T04:39:01.642537+0000","last_peered":"2024-09-17T04:39:01.642537+0000","last_clean":"2024-09-17T04:39:01.642537+0000","last_became_active":"2024-09-17T04:34:51.069714+0000","last_became_peered":"2024-09-17T04:34:51.069714+0000","last_unstale":"2024-09-17T04:39:01.642537+0000","last_undegraded":"2024-09-17T04:39:01.642537+0000","last_fullsized":"2024-09-17T04:39:01.642537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:28.082690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'6","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:41:06.657441+0000","last_change":"2024-09-17T04:34:52.069653+0000","last_active":"2024-09-17T04:41:06.657441+0000","last_peered":"2024-09-17T04:41:06.657441+0000","last_clean":"2024-09-17T04:41:06.657441+0000","last_became_active":"2024-09-17T04:34:52.069282+0000","last_became_peered":"2024-09-17T04:34:52.069282+0000","last_unstale":"2024-09-17T04:41:06.657441+0000","last_undegraded":"2024-09-17T04:41:06.657441+0000","last_fullsized":"2024-09-17T04:41:06.657441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:40.828725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.639231+0000","last_change":"2024-09-17T04:34:51.070676+0000","last_active":"2024-09-17T04:39:04.639231+0000","last_peered":"2024-09-17T04:39:04.639231+0000","last_clean":"2024-09-17T04:39:04.639231+0000","last_became_active":"2024-09-17T04:34:51.069006+0000","last_became_peered":"2024-09-17T04:34:51.069006+0000","last_unstale":"2024-09-17T04:39:04.639231+0000","last_undegraded":"2024-09-17T04:39:04.639231+0000","last_fullsized":"2024-09-17T04:39:04.639231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:45.452865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:41:06.657876+0000","last_change":"2024-09-17T04:34:52.087131+0000","last_active":"2024-09-17T04:41:06.657876+0000","last_peered":"2024-09-17T04:41:06.657876+0000","last_clean":"2024-09-17T04:41:06.657876+0000","last_became_active":"2024-09-17T04:34:52.086782+0000","last_became_peered":"2024-09-17T04:34:52.086782+0000","last_unstale":"2024-09-17T04:41:06.657876+0000","last_undegraded":"2024-09-17T04:41:06.657876+0000","last_fullsized":"2024-09-17T04:41:06.657876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:53.987579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:01.642786+0000","last_change":"2024-09-17T04:34:51.068708+0000","last_active":"2024-09-17T04:39:01.642786+0000","last_peered":"2024-09-17T04:39:01.642786+0000","last_clean":"2024-09-17T04:39:01.642786+0000","last_became_active":"2024-09-17T04:34:51.068354+0000","last_became_peered":"2024-09-17T04:34:51.068354+0000","last_unstale":"2024-09-17T04:39:01.642786+0000","last_undegraded":"2024-09-17T04:39:01.642786+0000","last_fullsized":"2024-09-17T04:39:01.642786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:04.219898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.639204+0000","last_change":"2024-09-17T04:34:52.071586+0000","last_active":"2024-09-17T04:39:04.639204+0000","last_peered":"2024-09-17T04:39:04.639204+0000","last_clean":"2024-09-17T04:39:04.639204+0000","last_became_active":"2024-09-17T04:34:52.071246+0000","last_became_peered":"2024-09-17T04:34:52.071246+0000","last_unstale":"2024-09-17T04:39:04.639204+0000","last_undegraded":"2024-09-17T04:39:04.639204+0000","last_fullsized":"2024-09-17T04:39:04.639204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:03.620107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'12","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640449+0000","last_change":"2024-09-17T04:34:51.078947+0000","last_active":"2024-09-17T04:39:14.640449+0000","last_peered":"2024-09-17T04:39:14.640449+0000","last_clean":"2024-09-17T04:39:14.640449+0000","last_became_active":"2024-09-17T04:34:51.078557+0000","last_became_peered":"2024-09-17T04:34:51.078557+0000","last_unstale":"2024-09-17T04:39:14.640449+0000","last_undegraded":"2024-09-17T04:39:14.640449+0000","last_fullsized":"2024-09-17T04:39:14.640449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:51.413772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640903+0000","last_change":"2024-09-17T04:34:52.086372+0000","last_active":"2024-09-17T04:39:14.640903+0000","last_peered":"2024-09-17T04:39:14.640903+0000","last_clean":"2024-09-17T04:39:14.640903+0000","last_became_active":"2024-09-17T04:34:52.086018+0000","last_became_peered":"2024-09-17T04:34:52.086018+0000","last_unstale":"2024-09-17T04:39:14.640903+0000","last_undegraded":"2024-09-17T04:39:14.640903+0000","last_fullsized":"2024-09-17T04:39:14.640903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:10.818503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:11.643392+0000","last_change":"2024-09-17T04:34:51.076427+0000","last_active":"2024-09-17T04:39:11.643392+0000","last_peered":"2024-09-17T04:39:11.643392+0000","last_clean":"2024-09-17T04:39:11.643392+0000","last_became_active":"2024-09-17T04:34:51.075881+0000","last_became_peered":"2024-09-17T04:34:51.075881+0000","last_unstale":"2024-09-17T04:39:11.643392+0000","last_undegraded":"2024-09-17T04:39:11.643392+0000","last_fullsized":"2024-09-17T04:39:11.643392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:40.903989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.641054+0000","last_change":"2024-09-17T04:34:52.076358+0000","last_active":"2024-09-17T04:39:14.641054+0000","last_peered":"2024-09-17T04:39:14.641054+0000","last_clean":"2024-09-17T04:39:14.641054+0000","last_became_active":"2024-09-17T04:34:52.076035+0000","last_became_peered":"2024-09-17T04:34:52.076035+0000","last_unstale":"2024-09-17T04:39:14.641054+0000","last_undegraded":"2024-09-17T04:39:14.641054+0000","last_fullsized":"2024-09-17T04:39:14.641054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:30.660617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:11.644007+0000","last_change":"2024-09-17T04:34:51.072737+0000","last_active":"2024-09-17T04:39:11.644007+0000","last_peered":"2024-09-17T04:39:11.644007+0000","last_clean":"2024-09-17T04:39:11.644007+0000","last_became_active":"2024-09-17T04:34:51.072378+0000","last_became_peered":"2024-09-17T04:34:51.072378+0000","last_unstale":"2024-09-17T04:39:11.644007+0000","last_undegraded":"2024-09-17T04:39:11.644007+0000","last_fullsized":"2024-09-17T04:39:11.644007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:27.364636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"24'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:41:21.658962+0000","last_change":"2024-09-17T04:34:52.068446+0000","last_active":"2024-09-17T04:41:21.658962+0000","last_peered":"2024-09-17T04:41:21.658962+0000","last_clean":"2024-09-17T04:41:21.658962+0000","last_became_active":"2024-09-17T04:34:52.068047+0000","last_became_peered":"2024-09-17T04:34:52.068047+0000","last_unstale":"2024-09-17T04:41:21.658962+0000","last_undegraded":"2024-09-17T04:41:21.658962+0000","last_fullsized":"2024-09-17T04:41:21.658962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:26.994189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640372+0000","last_change":"2024-09-17T04:34:51.069539+0000","last_active":"2024-09-17T04:39:14.640372+0000","last_peered":"2024-09-17T04:39:14.640372+0000","last_clean":"2024-09-17T04:39:14.640372+0000","last_became_active":"2024-09-17T04:34:51.067438+0000","last_became_peered":"2024-09-17T04:34:51.067438+0000","last_unstale":"2024-09-17T04:39:14.640372+0000","last_undegraded":"2024-09-17T04:39:14.640372+0000","last_fullsized":"2024-09-17T04:39:14.640372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:13.078391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640844+0000","last_change":"2024-09-17T04:34:52.078035+0000","last_active":"2024-09-17T04:39:14.640844+0000","last_peered":"2024-09-17T04:39:14.640844+0000","last_clean":"2024-09-17T04:39:14.640844+0000","last_became_active":"2024-09-17T04:34:52.077708+0000","last_became_peered":"2024-09-17T04:34:52.077708+0000","last_unstale":"2024-09-17T04:39:14.640844+0000","last_undegraded":"2024-09-17T04:39:14.640844+0000","last_fullsized":"2024-09-17T04:39:14.640844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:00.313209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:14.640414+0000","last_change":"2024-09-17T04:34:51.074749+0000","last_active":"2024-09-17T04:39:14.640414+0000","last_peered":"2024-09-17T04:39:14.640414+0000","last_clean":"2024-09-17T04:39:14.640414+0000","last_became_active":"2024-09-17T04:34:51.074393+0000","last_became_peered":"2024-09-17T04:34:51.074393+0000","last_unstale":"2024-09-17T04:39:14.640414+0000","last_undegraded":"2024-09-17T04:39:14.640414+0000","last_fullsized":"2024-09-17T04:39:14.640414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:39.558815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:24.641915+0000","last_change":"2024-09-17T04:34:52.075585+0000","last_active":"2024-09-17T04:39:24.641915+0000","last_peered":"2024-09-17T04:39:24.641915+0000","last_clean":"2024-09-17T04:39:24.641915+0000","last_became_active":"2024-09-17T04:34:52.075257+0000","last_became_peered":"2024-09-17T04:34:52.075257+0000","last_unstale":"2024-09-17T04:39:24.641915+0000","last_undegraded":"2024-09-17T04:39:24.641915+0000","last_fullsized":"2024-09-17T04:39:24.641915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:38.029256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:21.645156+0000","last_change":"2024-09-17T04:34:51.071324+0000","last_active":"2024-09-17T04:39:21.645156+0000","last_peered":"2024-09-17T04:39:21.645156+0000","last_clean":"2024-09-17T04:39:21.645156+0000","last_became_active":"2024-09-17T04:34:51.070944+0000","last_became_peered":"2024-09-17T04:34:51.070944+0000","last_unstale":"2024-09-17T04:39:21.645156+0000","last_undegraded":"2024-09-17T04:39:21.645156+0000","last_fullsized":"2024-09-17T04:39:21.645156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:13.931324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:11.643319+0000","last_change":"2024-09-17T04:34:52.081178+0000","last_active":"2024-09-17T04:39:11.643319+0000","last_peered":"2024-09-17T04:39:11.643319+0000","last_clean":"2024-09-17T04:39:11.643319+0000","last_became_active":"2024-09-17T04:34:52.080855+0000","last_became_peered":"2024-09-17T04:34:52.080855+0000","last_unstale":"2024-09-17T04:39:11.643319+0000","last_undegraded":"2024-09-17T04:39:11.643319+0000","last_fullsized":"2024-09-17T04:39:11.643319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:49.091080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.648795+0000","last_change":"2024-09-17T04:34:52.066633+0000","last_active":"2024-09-17T04:39:51.648795+0000","last_peered":"2024-09-17T04:39:51.648795+0000","last_clean":"2024-09-17T04:39:51.648795+0000","last_became_active":"2024-09-17T04:34:52.066263+0000","last_became_peered":"2024-09-17T04:34:52.066263+0000","last_unstale":"2024-09-17T04:39:51.648795+0000","last_undegraded":"2024-09-17T04:39:51.648795+0000","last_fullsized":"2024-09-17T04:39:51.648795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:13.396220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.649018+0000","last_change":"2024-09-17T04:34:51.067927+0000","last_active":"2024-09-17T04:39:51.649018+0000","last_peered":"2024-09-17T04:39:51.649018+0000","last_clean":"2024-09-17T04:39:51.649018+0000","last_became_active":"2024-09-17T04:34:51.067555+0000","last_became_peered":"2024-09-17T04:34:51.067555+0000","last_unstale":"2024-09-17T04:39:51.649018+0000","last_undegraded":"2024-09-17T04:39:51.649018+0000","last_fullsized":"2024-09-17T04:39:51.649018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:33.815585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.648774+0000","last_change":"2024-09-17T04:34:52.074529+0000","last_active":"2024-09-17T04:39:51.648774+0000","last_peered":"2024-09-17T04:39:51.648774+0000","last_clean":"2024-09-17T04:39:51.648774+0000","last_became_active":"2024-09-17T04:34:52.074149+0000","last_became_peered":"2024-09-17T04:34:52.074149+0000","last_unstale":"2024-09-17T04:39:51.648774+0000","last_undegraded":"2024-09-17T04:39:51.648774+0000","last_fullsized":"2024-09-17T04:39:51.648774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:31.679908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:51.649033+0000","last_change":"2024-09-17T04:34:51.078231+0000","last_active":"2024-09-17T04:39:51.649033+0000","last_peered":"2024-09-17T04:39:51.649033+0000","last_clean":"2024-09-17T04:39:51.649033+0000","last_became_active":"2024-09-17T04:34:51.077872+0000","last_became_peered":"2024-09-17T04:34:51.077872+0000","last_unstale":"2024-09-17T04:39:51.649033+0000","last_undegraded":"2024-09-17T04:39:51.649033+0000","last_fullsized":"2024-09-17T04:39:51.649033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:38.304333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:49.644999+0000","last_change":"2024-09-17T04:35:37.198244+0000","last_active":"2024-09-17T04:39:49.644999+0000","last_peered":"2024-09-17T04:39:49.644999+0000","last_clean":"2024-09-17T04:39:49.644999+0000","last_became_active":"2024-09-17T04:35:37.197990+0000","last_became_peered":"2024-09-17T04:35:37.197990+0000","last_unstale":"2024-09-17T04:39:49.644999+0000","last_undegraded":"2024-09-17T04:39:49.644999+0000","last_fullsized":"2024-09-17T04:39:49.644999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:47:41.801990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:54.638937+0000","last_change":"2024-09-17T04:34:51.073959+0000","last_active":"2024-09-17T04:38:54.638937+0000","last_peered":"2024-09-17T04:38:54.638937+0000","last_clean":"2024-09-17T04:38:54.638937+0000","last_became_active":"2024-09-17T04:34:51.073496+0000","last_became_peered":"2024-09-17T04:34:51.073496+0000","last_unstale":"2024-09-17T04:38:54.638937+0000","last_undegraded":"2024-09-17T04:38:54.638937+0000","last_fullsized":"2024-09-17T04:38:54.638937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:23.001571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:38:54.638910+0000","last_change":"2024-09-17T04:34:52.081971+0000","last_active":"2024-09-17T04:38:54.638910+0000","last_peered":"2024-09-17T04:38:54.638910+0000","last_clean":"2024-09-17T04:38:54.638910+0000","last_became_active":"2024-09-17T04:34:52.081259+0000","last_became_peered":"2024-09-17T04:34:52.081259+0000","last_unstale":"2024-09-17T04:38:54.638910+0000","last_undegraded":"2024-09-17T04:38:54.638910+0000","last_fullsized":"2024-09-17T04:38:54.638910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:51.046855+0000","last_clean_scrub_stamp":"2024-09-17T04:34:51.046855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:43.915741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-17T04:39:04.640080+0000","last_change":"2024-09-17T04:34:51.070142+0000","last_active":"2024-09-17T04:39:04.640080+0000","last_peered":"2024-09-17T04:39:04.640080+0000","last_clean":"2024-09-17T04:39:04.640080+0000","last_became_active":"2024-09-17T04:34:51.069777+0000","last_became_peered":"2024-09-17T04:34:51.069777+0000","last_unstale":"2024-09-17T04:39:04.640080+0000","last_undegraded":"2024-09-17T04:39:04.640080+0000","last_fullsized":"2024-09-17T04:39:04.640080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:34:50.038722+0000","last_clean_scrub_stamp":"2024-09-17T04:34:50.038722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:51.718064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":41622,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":172,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":83071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476834,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":680436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476834,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":126724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476834,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":90130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476834,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":258048,"data_stored":89722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542241,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35640,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336200,"statfs":{"total":96636764160,"available":96600268800,"internally_reserved":0,"allocated":303104,"data_stored":126906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542241,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":89974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542242,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":89696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542242,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":679780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":38154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:42:33.188 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:42:33.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.341+0000 7f9742590640 1 -- 172.21.15.43:0/2834797950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f973c0c2140 msgr2=0x7f973c14e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:33.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.341+0000 7f9742590640 1 --2- 172.21.15.43:0/2834797950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f973c0c2140 0x7f973c14e560 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f973c0ca250 tx=0x7f972c02a580 comp rx=0 tx=0).stop 2024-09-17T04:42:33.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.341+0000 7f9742590640 1 -- 172.21.15.43:0/2834797950 shutdown_connections 2024-09-17T04:42:33.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.341+0000 7f9742590640 1 --2- 172.21.15.43:0/2834797950 >> v2:172.21.15.43:3300/0 conn(0x7f973c158760 0x7f973c06ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:33.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.341+0000 7f9742590640 1 --2- 172.21.15.43:0/2834797950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f973c0c2140 0x7f973c14e560 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:33.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.341+0000 7f9742590640 1 -- 172.21.15.43:0/2834797950 >> 172.21.15.43:0/2834797950 conn(0x7f973c070540 msgr2=0x7f973c070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:42:33.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.341+0000 7f9742590640 1 -- 172.21.15.43:0/2834797950 shutdown_connections 2024-09-17T04:42:33.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.341+0000 7f9742590640 1 -- 172.21.15.43:0/2834797950 wait complete. 2024-09-17T04:42:33.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.342+0000 7f9742590640 1 Processor -- start 2024-09-17T04:42:33.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.343+0000 7f9742590640 1 -- start start 2024-09-17T04:42:33.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.344+0000 7f9742590640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f973c0c2140 0x7f973c0c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:33.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.344+0000 7f9742590640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f973c158350 0x7f973c0c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:33.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.344+0000 7f9742590640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f973c158760 0x7f973c0c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.344+0000 7f973bfff640 1 -- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f973c0c2140 msgr2=0x7f973c0c3f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:3300/0 2024-09-17T04:42:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.344+0000 7f9742590640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f973c157e30 con 0x7f973c0c2140 2024-09-17T04:42:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.344+0000 7f9742590640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f973c0c92b0 con 0x7f973c158350 2024-09-17T04:42:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.344+0000 7f9742590640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f973c14eaa0 con 0x7f973c158760 2024-09-17T04:42:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.344+0000 7f973bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f973c0c2140 0x7f973c0c3f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T04:42:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.344+0000 7f973b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f973c158350 0x7f973c0c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:42:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.344+0000 7f9740b2d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f973c158760 0x7f973c0c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:42:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.344+0000 7f973b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f973c158350 0x7f973c0c5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.43:39666/0 (socket says 172.21.15.43:39666) 2024-09-17T04:42:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.344+0000 7f973b7fe640 1 -- 172.21.15.43:0/1742718364 learned_addr learned my addr 172.21.15.43:0/1742718364 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T04:42:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.344+0000 7f9740b2d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f973c158760 0x7f973c0c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.43:58314/0 (socket says 172.21.15.43:58314) 2024-09-17T04:42:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.345+0000 7f973b7fe640 1 -- 172.21.15.43:0/1742718364 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f973c158760 msgr2=0x7f973c0c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.345+0000 7f973b7fe640 1 --2- 172.21.15.43:0/1742718364 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f973c158760 0x7f973c0c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.345+0000 7f973b7fe640 1 -- 172.21.15.43:0/1742718364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f973c0c2140 msgr2=0x7f973c0c3f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:42:33.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.345+0000 7f973b7fe640 1 --2- 172.21.15.43:0/1742718364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f973c0c2140 0x7f973c0c3f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:33.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.345+0000 7f973b7fe640 1 -- 172.21.15.43:0/1742718364 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973c1f0820 con 0x7f973c158350 2024-09-17T04:42:33.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.345+0000 7f973b7fe640 1 --2- 172.21.15.43:0/1742718364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f973c158350 0x7f973c0c5230 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f973000b4d0 tx=0x7f973000b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:42:33.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.345+0000 7f9738ff9640 1 -- 172.21.15.43:0/1742718364 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9730014070 con 0x7f973c158350 2024-09-17T04:42:33.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.345+0000 7f9738ff9640 1 -- 172.21.15.43:0/1742718364 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9730010960 con 0x7f973c158350 2024-09-17T04:42:33.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.345+0000 7f9738ff9640 1 -- 172.21.15.43:0/1742718364 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9730010db0 con 0x7f973c158350 2024-09-17T04:42:33.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.345+0000 7f9742590640 1 -- 172.21.15.43:0/1742718364 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f973c149120 con 0x7f973c158350 2024-09-17T04:42:33.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.345+0000 7f9742590640 1 -- 172.21.15.43:0/1742718364 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f973c1e3c90 con 0x7f973c158350 2024-09-17T04:42:33.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.346+0000 7f9742590640 1 -- 172.21.15.43:0/1742718364 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f973c149640 con 0x7f973c158350 2024-09-17T04:42:33.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.347+0000 7f9738ff9640 1 -- 172.21.15.43:0/1742718364 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9730017070 con 0x7f973c158350 2024-09-17T04:42:33.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.348+0000 7f9738ff9640 1 --2- 172.21.15.43:0/1742718364 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9728078b70 0x7f972807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:42:33.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.348+0000 7f9738ff9640 1 -- 172.21.15.43:0/1742718364 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5833+0+0 (secure 0 0 0) 0x7f973009af20 con 0x7f973c158350 2024-09-17T04:42:33.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.348+0000 7f973bfff640 1 --2- 172.21.15.43:0/1742718364 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9728078b70 0x7f972807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:42:33.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.349+0000 7f973bfff640 1 --2- 172.21.15.43:0/1742718364 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9728078b70 0x7f972807b080 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f972c033000 tx=0x7f972c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:42:33.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.352+0000 7f9738ff9640 1 -- 172.21.15.43:0/1742718364 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9730062d20 con 0x7f973c158350 2024-09-17T04:42:33.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.537+0000 7f9742590640 1 -- 172.21.15.43:0/1742718364 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f973c072e10 con 0x7f973c158350 2024-09-17T04:42:33.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.540+0000 7f9738ff9640 1 -- 172.21.15.43:0/1742718364 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16908 (secure 0 0 0) 0x7f9730067750 con 0x7f973c158350 2024-09-17T04:42:33.539 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T04:42:33.539 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":24,"fsid":"cdef1e3e-07e6-43e6-b635-3ed1bc15d64a","created":"2024-09-17T04:34:26.485007+0000","modified":"2024-09-17T04:35:37.182711+0000","last_up_change":"2024-09-17T04:34:40.712497+0000","last_in_change":"2024-09-17T04:34:30.384271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:34:38.905735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:34:49.341236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:34:50.401489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eaab925a-60b4-429f-aee1-50de6f32358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6817","nonce":1685480205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6819","nonce":1685480205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6823","nonce":1685480205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1685480205},{"type":"v1","addr":"172.21.15.43:6821","nonce":1685480205}]},"public_addr":"172.21.15.43:6817/1685480205","cluster_addr":"172.21.15.43:6819/1685480205","heartbeat_back_addr":"172.21.15.43:6823/1685480205","heartbeat_front_addr":"172.21.15.43:6821/1685480205","state":["exists","up"]},{"osd":1,"uuid":"2c0e64be-db05-45db-aad8-2f2f42812100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6825","nonce":1564354446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6827","nonce":1564354446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6831","nonce":1564354446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1564354446},{"type":"v1","addr":"172.21.15.43:6829","nonce":1564354446}]},"public_addr":"172.21.15.43:6825/1564354446","cluster_addr":"172.21.15.43:6827/1564354446","heartbeat_back_addr":"172.21.15.43:6831/1564354446","heartbeat_front_addr":"172.21.15.43:6829/1564354446","state":["exists","up"]},{"osd":2,"uuid":"fa88665d-2acb-4e44-99ac-1d496adf5b94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6801","nonce":1385342605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6803","nonce":1385342605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6807","nonce":1385342605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1385342605},{"type":"v1","addr":"172.21.15.43:6805","nonce":1385342605}]},"public_addr":"172.21.15.43:6801/1385342605","cluster_addr":"172.21.15.43:6803/1385342605","heartbeat_back_addr":"172.21.15.43:6807/1385342605","heartbeat_front_addr":"172.21.15.43:6805/1385342605","state":["exists","up"]},{"osd":3,"uuid":"710a28f0-d04a-4b4a-bba3-28f7c7b1eb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6809","nonce":1646004903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6811","nonce":1646004903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6815","nonce":1646004903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1646004903},{"type":"v1","addr":"172.21.15.43:6813","nonce":1646004903}]},"public_addr":"172.21.15.43:6809/1646004903","cluster_addr":"172.21.15.43:6811/1646004903","heartbeat_back_addr":"172.21.15.43:6815/1646004903","heartbeat_front_addr":"172.21.15.43:6813/1646004903","state":["exists","up"]},{"osd":4,"uuid":"d2eca96b-1917-4dbb-b6e3-f4410bbc5c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6803","nonce":3991694106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6805","nonce":3991694106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6809","nonce":3991694106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3991694106},{"type":"v1","addr":"172.21.15.62:6807","nonce":3991694106}]},"public_addr":"172.21.15.62:6803/3991694106","cluster_addr":"172.21.15.62:6805/3991694106","heartbeat_back_addr":"172.21.15.62:6809/3991694106","heartbeat_front_addr":"172.21.15.62:6807/3991694106","state":["exists","up"]},{"osd":5,"uuid":"ae843bea-38ff-4ca6-a7a9-6e58c7a17fd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6827","nonce":2558615114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6829","nonce":2558615114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6833","nonce":2558615114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2558615114},{"type":"v1","addr":"172.21.15.62:6831","nonce":2558615114}]},"public_addr":"172.21.15.62:6827/2558615114","cluster_addr":"172.21.15.62:6829/2558615114","heartbeat_back_addr":"172.21.15.62:6833/2558615114","heartbeat_front_addr":"172.21.15.62:6831/2558615114","state":["exists","up"]},{"osd":6,"uuid":"44c53356-010d-443f-9e8d-f0d5da106893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6811","nonce":1901653154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6813","nonce":1901653154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6817","nonce":1901653154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1901653154},{"type":"v1","addr":"172.21.15.62:6815","nonce":1901653154}]},"public_addr":"172.21.15.62:6811/1901653154","cluster_addr":"172.21.15.62:6813/1901653154","heartbeat_back_addr":"172.21.15.62:6817/1901653154","heartbeat_front_addr":"172.21.15.62:6815/1901653154","state":["exists","up"]},{"osd":7,"uuid":"c8960d11-dd10-4e36-b9d8-f1fdc0abe9c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6819","nonce":2974376041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6821","nonce":2974376041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6825","nonce":2974376041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2974376041},{"type":"v1","addr":"172.21.15.62:6823","nonce":2974376041}]},"public_addr":"172.21.15.62:6819/2974376041","cluster_addr":"172.21.15.62:6821/2974376041","heartbeat_back_addr":"172.21.15.62:6825/2974376041","heartbeat_front_addr":"172.21.15.62:6823/2974376041","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.435063+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.372079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:35.973575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.690029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.944690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.691776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.877497+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:34:36.689786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2},{"from":7,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:42:33.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.541+0000 7f9742590640 1 -- 172.21.15.43:0/1742718364 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9728078b70 msgr2=0x7f972807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:33.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.541+0000 7f9742590640 1 --2- 172.21.15.43:0/1742718364 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9728078b70 0x7f972807b080 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f972c033000 tx=0x7f972c004730 comp rx=0 tx=0).stop 2024-09-17T04:42:33.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.541+0000 7f9742590640 1 -- 172.21.15.43:0/1742718364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f973c158350 msgr2=0x7f973c0c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:42:33.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.541+0000 7f9742590640 1 --2- 172.21.15.43:0/1742718364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f973c158350 0x7f973c0c5230 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f973000b4d0 tx=0x7f973000b990 comp rx=0 tx=0).stop 2024-09-17T04:42:33.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.541+0000 7f9742590640 1 -- 172.21.15.43:0/1742718364 shutdown_connections 2024-09-17T04:42:33.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.541+0000 7f9742590640 1 --2- 172.21.15.43:0/1742718364 >> [v2:172.21.15.62:6800/1186143747,v1:172.21.15.62:6801/1186143747] conn(0x7f9728078b70 0x7f972807b080 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:33.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.541+0000 7f9742590640 1 --2- 172.21.15.43:0/1742718364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f973c158350 0x7f973c0c5230 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:33.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.541+0000 7f9742590640 1 --2- 172.21.15.43:0/1742718364 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f973c158760 0x7f973c0c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:33.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.541+0000 7f9742590640 1 --2- 172.21.15.43:0/1742718364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f973c0c2140 0x7f973c0c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:42:33.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.541+0000 7f9742590640 1 -- 172.21.15.43:0/1742718364 >> 172.21.15.43:0/1742718364 conn(0x7f973c070540 msgr2=0x7f973c070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:42:33.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.541+0000 7f9742590640 1 -- 172.21.15.43:0/1742718364 shutdown_connections 2024-09-17T04:42:33.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T04:42:33.541+0000 7f9742590640 1 -- 172.21.15.43:0/1742718364 wait complete. 2024-09-17T04:42:34.256 INFO:tasks.ceph.osd.0:Sent signal 15 2024-09-17T04:42:34.257 INFO:tasks.ceph.osd.1:Sent signal 15 2024-09-17T04:42:34.257 INFO:tasks.ceph.osd.2:Sent signal 15 2024-09-17T04:42:34.257 INFO:tasks.ceph.osd.3:Sent signal 15 2024-09-17T04:42:34.257 INFO:tasks.ceph.osd.4:Sent signal 15 2024-09-17T04:42:34.258 INFO:tasks.ceph.osd.5:Sent signal 15 2024-09-17T04:42:34.258 INFO:tasks.ceph.osd.6:Sent signal 15 2024-09-17T04:42:34.258 INFO:tasks.ceph.osd.7:Sent signal 15 2024-09-17T04:42:34.258 INFO:tasks.ceph.mds.a:Sent signal 15 2024-09-17T04:42:34.258 INFO:tasks.ceph.mds.c:Sent signal 15 2024-09-17T04:42:34.259 INFO:tasks.ceph.mds.e:Sent signal 15 2024-09-17T04:42:34.259 INFO:tasks.ceph.mds.b:Sent signal 15 2024-09-17T04:42:34.259 INFO:tasks.ceph.mds.d:Sent signal 15 2024-09-17T04:42:34.259 INFO:tasks.ceph.mds.f:Sent signal 15 2024-09-17T04:42:34.259 ERROR:tasks.ceph.mon.a:No such daemon running 2024-09-17T04:42:34.260 INFO:tasks.ceph.mon.b:Sent signal 15 2024-09-17T04:42:34.260 INFO:tasks.ceph.mon.c:Sent signal 15 2024-09-17T04:42:34.260 INFO:tasks.ceph.mgr.y:Sent signal 15 2024-09-17T04:42:34.260 INFO:tasks.ceph.mgr.x:Sent signal 15 2024-09-17T04:42:34.261 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-09-17T04:42:34.258+0000 7f847617f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 37353) UID: 0 2024-09-17T04:42:34.261 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-09-17T04:42:34.258+0000 7f847617f640 -1 osd.4 24 *** Got signal Terminated *** 2024-09-17T04:42:34.262 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-09-17T04:42:34.258+0000 7f847617f640 -1 osd.4 24 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:42:34.262 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-09-17T04:42:34.258+0000 7fb15f39a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 37972) UID: 0 2024-09-17T04:42:34.262 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-09-17T04:42:34.258+0000 7fb15f39a640 -1 osd.0 24 *** Got signal Terminated *** 2024-09-17T04:42:34.262 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-09-17T04:42:34.258+0000 7fb15f39a640 -1 osd.0 24 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:42:34.262 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-09-17T04:42:34.258+0000 7f92ed14a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 37349) UID: 0 2024-09-17T04:42:34.262 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-09-17T04:42:34.258+0000 7f92ed14a640 -1 osd.5 24 *** Got signal Terminated *** 2024-09-17T04:42:34.262 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-09-17T04:42:34.258+0000 7f92ed14a640 -1 osd.5 24 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:42:34.263 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-09-17T04:42:34.258+0000 7fcafa15d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 37975) UID: 0 2024-09-17T04:42:34.263 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-09-17T04:42:34.258+0000 7fcafa15d640 -1 osd.1 24 *** Got signal Terminated *** 2024-09-17T04:42:34.263 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-09-17T04:42:34.258+0000 7fcafa15d640 -1 osd.1 24 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:42:34.263 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-09-17T04:42:34.258+0000 7f534cf5f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 37352) UID: 0 2024-09-17T04:42:34.263 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-09-17T04:42:34.258+0000 7f534cf5f640 -1 osd.6 24 *** Got signal Terminated *** 2024-09-17T04:42:34.263 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-09-17T04:42:34.258+0000 7f534cf5f640 -1 osd.6 24 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:42:34.264 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-09-17T04:42:34.258+0000 7f192648a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 37984) UID: 0 2024-09-17T04:42:34.264 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-09-17T04:42:34.258+0000 7f192648a640 -1 osd.2 24 *** Got signal Terminated *** 2024-09-17T04:42:34.264 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-09-17T04:42:34.258+0000 7f192648a640 -1 osd.2 24 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:42:34.264 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-09-17T04:42:34.259+0000 7f3e1ef26640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 37356) UID: 0 2024-09-17T04:42:34.265 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-09-17T04:42:34.259+0000 7f3e1ef26640 -1 osd.7 24 *** Got signal Terminated *** 2024-09-17T04:42:34.265 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-09-17T04:42:34.259+0000 7f3e1ef26640 -1 osd.7 24 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:42:34.265 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-09-17T04:42:34.258+0000 7f48886ac640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 37987) UID: 0 2024-09-17T04:42:34.265 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-09-17T04:42:34.258+0000 7f48886ac640 -1 osd.3 24 *** Got signal Terminated *** 2024-09-17T04:42:34.265 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-09-17T04:42:34.258+0000 7f48886ac640 -1 osd.3 24 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T04:42:34.265 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-09-17T04:42:34.259+0000 7fab91935640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 43035) UID: 0 2024-09-17T04:42:34.266 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-09-17T04:42:34.259+0000 7fab91935640 -1 mds.b *** got signal Terminated *** 2024-09-17T04:42:34.266 INFO:tasks.ceph.mds.a.smithi043.stderr:2024-09-17T04:42:34.260+0000 7f949cc57640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 41889) UID: 0 2024-09-17T04:42:34.266 INFO:tasks.ceph.mds.a.smithi043.stderr:2024-09-17T04:42:34.260+0000 7f949cc57640 -1 mds.a *** got signal Terminated *** 2024-09-17T04:42:34.266 INFO:tasks.ceph.mds.f.smithi062.stderr:2024-09-17T04:42:34.260+0000 7f92a9284640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i f (PID: 43040) UID: 0 2024-09-17T04:42:34.266 INFO:tasks.ceph.mds.f.smithi062.stderr:2024-09-17T04:42:34.260+0000 7f92a9284640 -1 mds.f *** got signal Terminated *** 2024-09-17T04:42:34.267 INFO:tasks.ceph.mds.c.smithi043.stderr:2024-09-17T04:42:34.260+0000 7f8604706640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 41895) UID: 0 2024-09-17T04:42:34.267 INFO:tasks.ceph.mds.c.smithi043.stderr:2024-09-17T04:42:34.260+0000 7f8604706640 -1 mds.c *** got signal Terminated *** 2024-09-17T04:42:34.267 INFO:tasks.ceph.mds.d.smithi062.stderr:2024-09-17T04:42:34.260+0000 7fb346142640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 43038) UID: 0 2024-09-17T04:42:34.267 INFO:tasks.ceph.mds.d.smithi062.stderr:2024-09-17T04:42:34.260+0000 7fb346142640 -1 mds.d *** got signal Terminated *** 2024-09-17T04:42:34.267 INFO:tasks.ceph.mds.e.smithi043.stderr:2024-09-17T04:42:34.260+0000 7f69ef104640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i e (PID: 41900) UID: 0 2024-09-17T04:42:34.267 INFO:tasks.ceph.mds.e.smithi043.stderr:2024-09-17T04:42:34.260+0000 7f69ef104640 -1 mds.e *** got signal Terminated *** 2024-09-17T04:42:34.268 INFO:tasks.ceph.mon.b.smithi062.stderr:2024-09-17T04:42:34.260+0000 7f6e67816640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 36769) UID: 0 2024-09-17T04:42:34.268 INFO:tasks.ceph.mon.b.smithi062.stderr:2024-09-17T04:42:34.260+0000 7f6e67816640 -1 mon.b@1(leader) e1 *** Got Signal Terminated *** 2024-09-17T04:42:34.268 INFO:tasks.ceph.mon.c.smithi062.stderr:2024-09-17T04:42:34.260+0000 7f41e9dac640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 43186) UID: 0 2024-09-17T04:42:34.268 INFO:tasks.ceph.mon.c.smithi062.stderr:2024-09-17T04:42:34.260+0000 7f41e9dac640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-09-17T04:42:34.461 INFO:tasks.ceph.mgr.y.smithi043.stderr:daemon-helper: command crashed with signal 15 2024-09-17T04:42:34.554 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T04:42:34.554 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:42:50.464 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:42:50.468 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:43:20.546 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:43:20.550 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:43:50.619 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:43:50.623 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:44:20.682 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:44:20.687 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:44:34.593 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-17T04:44:34.594 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T04:44:34.594 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:44:50.745 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:44:50.748 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:45:20.808 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:45:20.812 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:45:50.872 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:45:50.876 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:46:20.932 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:46:20.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:46:34.631 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-17T04:46:34.632 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T04:46:34.632 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:46:50.995 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:46:50.999 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:47:21.062 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:47:21.066 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:47:51.129 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:47:51.134 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:48:21.198 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:48:21.201 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:48:34.668 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-17T04:48:34.669 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T04:48:34.670 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:48:51.269 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:48:51.273 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:49:21.334 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:49:21.338 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:49:51.397 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:49:51.401 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:50:21.460 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:50:21.464 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:50:34.707 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-17T04:50:34.708 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T04:50:34.708 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:50:51.524 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:50:51.527 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:51:21.591 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:51:21.595 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:51:51.656 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:51:51.660 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:52:21.841 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:52:21.845 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:52:34.745 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-17T04:52:34.746 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T04:52:34.746 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:52:51.936 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:52:51.939 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:53:22.003 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:53:22.006 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:53:52.074 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:53:52.077 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:54:22.136 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:54:22.140 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:54:34.783 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-17T04:54:34.783 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T04:54:34.784 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:54:52.307 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:54:52.310 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:55:22.395 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:55:22.399 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:55:52.467 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:55:52.471 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:56:22.531 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:56:22.535 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:56:34.820 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-17T04:56:34.821 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T04:56:34.822 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:56:52.599 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:56:52.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:57:22.663 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:57:22.667 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:57:52.746 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:57:52.750 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:58:22.813 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:58:22.817 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:58:34.859 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-17T04:58:34.860 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:58:52.881 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:58:52.884 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:59:22.956 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:59:22.960 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:59:53.018 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:59:53.022 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:00:23.100 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:00:23.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:00:34.896 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-17T05:00:34.897 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph.py", line 2000, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph.py", line 1349, in osd_scrub_pgs stats = manager.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 2464, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 1696, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 1687, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi043 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-09-17T05:00:34.899 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T05:00:34.899 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:00:34.899 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.900 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:00:34.900 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:00:34.900 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.900 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:00:34.900 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-09-17T05:00:34.900 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.900 INFO:tasks.ceph.mds.e:Stopped 2024-09-17T05:00:34.901 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:00:34.901 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.901 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:00:34.901 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:00:34.901 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.901 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:00:34.901 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-09-17T05:00:34.901 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.902 INFO:tasks.ceph.mds.f:Stopped 2024-09-17T05:00:34.902 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T05:00:34.902 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T05:00:34.902 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.902 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T05:00:34.902 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T05:00:34.902 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.902 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T05:00:34.903 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T05:00:34.903 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.903 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T05:00:34.903 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T05:00:34.903 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.903 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T05:00:34.904 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T05:00:34.904 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.904 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T05:00:34.904 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T05:00:34.904 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.904 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T05:00:34.904 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T05:00:34.904 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.904 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T05:00:34.905 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T05:00:34.905 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.905 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T05:00:34.906 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T05:00:34.906 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T05:00:34.906 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:00:34.906 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph.py", line 1515, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph.py", line 2000, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph.py", line 1349, in osd_scrub_pgs stats = manager.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 2464, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 1696, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 1687, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi043 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/daemon/state.py", line 146, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi043 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2024-09-17T05:00:34.907 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T05:00:34.907 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T05:00:34.907 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.907 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T05:00:34.907 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T05:00:34.907 ERROR:tasks.ceph.mon.a:tried to stop a non-running daemon 2024-09-17T05:00:34.907 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T05:00:34.908 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.908 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T05:00:34.908 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T05:00:34.908 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:00:34.908 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T05:00:34.908 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T05:00:34.909 DEBUG:teuthology.orchestra.run.smithi043:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | head -n 1 2024-09-17T05:00:34.973 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T05:00:34.973 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T05:00:35.072 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T05:00:35.072 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T05:00:35.263 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T05:00:35.263 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T05:00:35.336 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T05:00:35.337 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T05:00:35.378 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-17T05:00:35.378 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T05:00:35.482 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-17T05:00:35.482 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T05:00:35.531 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-17T05:00:35.531 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T05:00:35.581 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-17T05:00:35.581 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T05:00:35.748 INFO:tasks.ceph:Archiving mon data... 2024-09-17T05:00:35.749 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908543/data/mon.a.tgz 2024-09-17T05:00:35.750 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-09-17T05:00:35.767 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.TasEuX1iXp 2024-09-17T05:00:35.767 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.TasEuX1iXp 2024-09-17T05:00:35.921 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.TasEuX1iXp 2024-09-17T05:00:36.006 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.TasEuX1iXp is 265KB 2024-09-17T05:00:36.102 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.TasEuX1iXp 2024-09-17T05:00:36.117 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908543/data/mon.b.tgz 2024-09-17T05:00:36.117 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-09-17T05:00:36.136 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.CRCHpmio3S 2024-09-17T05:00:36.136 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.CRCHpmio3S 2024-09-17T05:00:36.298 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.CRCHpmio3S 2024-09-17T05:00:36.383 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.CRCHpmio3S is 426KB 2024-09-17T05:00:36.479 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.CRCHpmio3S 2024-09-17T05:00:36.494 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908543/data/mon.c.tgz 2024-09-17T05:00:36.494 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-09-17T05:00:36.549 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.1q6wxzbJFF 2024-09-17T05:00:36.549 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.1q6wxzbJFF 2024-09-17T05:00:36.686 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.1q6wxzbJFF 2024-09-17T05:00:36.767 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.1q6wxzbJFF is 369KB 2024-09-17T05:00:36.863 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.1q6wxzbJFF 2024-09-17T05:00:36.878 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T05:00:36.878 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T05:00:36.880 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T05:00:36.965 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T05:00:36.996 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T05:00:36.996 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T05:00:36.998 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908543/remote/smithi043/crash 2024-09-17T05:00:36.999 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T05:00:37.033 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908543/remote/smithi062/crash 2024-09-17T05:00:37.034 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T05:00:37.059 INFO:tasks.ceph:Shutting down logrotate 2024-09-17T05:00:37.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:00:37.077 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:00:37.161 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T05:00:37.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T05:00:37.212 INFO:tasks.ceph:Compressing logs... 2024-09-17T05:00:37.212 DEBUG:teuthology.orchestra.run.smithi043:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T05:00:37.231 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T05:00:37.266 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T05:00:37.266 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47133.log 2024-09-17T05:00:37.266 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44106.log 2024-09-17T05:00:37.266 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.47133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37217.log 2024-09-17T05:00:37.266 INFO:teuthology.orchestra.run.smithi043.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47133.log.gz 2024-09-17T05:00:37.266 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.44106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42051.log 2024-09-17T05:00:37.266 INFO:teuthology.orchestra.run.smithi043.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44106.log.gz 2024-09-17T05:00:37.267 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45127.log 2024-09-17T05:00:37.267 INFO:teuthology.orchestra.run.smithi043.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.37217.log.gz 2024-09-17T05:00:37.267 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42493.log 2024-09-17T05:00:37.267 INFO:teuthology.orchestra.run.smithi043.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42051.log.gz 2024-09-17T05:00:37.267 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44064.log 2024-09-17T05:00:37.267 INFO:teuthology.orchestra.run.smithi043.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45127.log.gz 2024-09-17T05:00:37.267 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42325.log 2024-09-17T05:00:37.267 INFO:teuthology.orchestra.run.smithi043.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42493.log.gz 2024-09-17T05:00:37.267 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.44064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44823.log 2024-09-17T05:00:37.267 INFO:teuthology.orchestra.run.smithi043.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44064.log.gz 2024-09-17T05:00:37.267 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47175.log 2024-09-17T05:00:37.267 INFO:teuthology.orchestra.run.smithi043.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42325.log.gz 2024-09-17T05:00:37.267 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.44823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43302.log 2024-09-17T05:00:37.268 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44823.log.gz 2024-09-17T05:00:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.47175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44148.log 2024-09-17T05:00:37.268 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47175.log.gz 2024-09-17T05:00:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45855.log 2024-09-17T05:00:37.268 INFO:teuthology.orchestra.run.smithi043.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43302.log.gz 2024-09-17T05:00:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.44148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42093.log 2024-09-17T05:00:37.268 INFO:teuthology.orchestra.run.smithi043.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44148.log.gz 2024-09-17T05:00:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37377.log 2024-09-17T05:00:37.268 INFO:teuthology.orchestra.run.smithi043.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45855.log.gz 2024-09-17T05:00:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37994.log 2024-09-17T05:00:37.268 INFO:teuthology.orchestra.run.smithi043.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42093.log.gz 2024-09-17T05:00:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43312.log 2024-09-17T05:00:37.268 INFO:teuthology.orchestra.run.smithi043.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.37377.log.gz 2024-09-17T05:00:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37122.log 2024-09-17T05:00:37.268 INFO:teuthology.orchestra.run.smithi043.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37994.log.gz 2024-09-17T05:00:37.269 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41792.log 2024-09-17T05:00:37.269 INFO:teuthology.orchestra.run.smithi043.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43312.log.gz 2024-09-17T05:00:37.269 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43300.log 2024-09-17T05:00:37.269 INFO:teuthology.orchestra.run.smithi043.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37122.log.gz 2024-09-17T05:00:37.269 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.41792.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T05:00:37.269 INFO:teuthology.orchestra.run.smithi043.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41792.log.gz 2024-09-17T05:00:37.269 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45043.log 2024-09-17T05:00:37.269 INFO:teuthology.orchestra.run.smithi043.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43300.log.gz 2024-09-17T05:00:37.269 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47909.log 2024-09-17T05:00:37.269 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46307.log 2024-09-17T05:00:37.269 INFO:teuthology.orchestra.run.smithi043.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45043.log.gz 2024-09-17T05:00:37.269 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.47909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47909.log.gz 2024-09-17T05:00:37.269 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47291.log 2024-09-17T05:00:37.269 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.46307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45771.log 2024-09-17T05:00:37.270 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46307.log.gz 2024-09-17T05:00:37.270 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.47291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45813.log 2024-09-17T05:00:37.270 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47291.log.gz 2024-09-17T05:00:37.270 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37266.log 2024-09-17T05:00:37.270 INFO:teuthology.orchestra.run.smithi043.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45771.log.gz 2024-09-17T05:00:37.270 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42795.log 2024-09-17T05:00:37.270 INFO:teuthology.orchestra.run.smithi043.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45813.log.gz 2024-09-17T05:00:37.270 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37029.log 2024-09-17T05:00:37.270 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37266.log: /var/log/ceph/ceph-client.admin.42795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43313.log 2024-09-17T05:00:37.270 INFO:teuthology.orchestra.run.smithi043.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.37266.log.gz 2024-09-17T05:00:37.270 INFO:teuthology.orchestra.run.smithi043.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42795.log.gz 2024-09-17T05:00:37.270 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44022.log 2024-09-17T05:00:37.270 INFO:teuthology.orchestra.run.smithi043.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.37029.log.gz 2024-09-17T05:00:37.270 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47600.log 2024-09-17T05:00:37.270 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43313.log: /var/log/ceph/ceph-client.admin.44022.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43313.log.gz 2024-09-17T05:00:37.271 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43509.log 2024-09-17T05:00:37.271 INFO:teuthology.orchestra.run.smithi043.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44022.log.gz 2024-09-17T05:00:37.271 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46674.log 2024-09-17T05:00:37.271 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.47600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47600.log.gz 2024-09-17T05:00:37.271 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.43509.log: /var/log/ceph/ceph-client.admin.42283.log 2024-09-17T05:00:37.288 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T05:00:37.289 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-17T05:00:37.289 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37139.log 2024-09-17T05:00:37.289 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T05:00:37.289 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37139.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T05:00:37.289 INFO:teuthology.orchestra.run.smithi062.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37139.log.gz 2024-09-17T05:00:37.289 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36979.log 2024-09-17T05:00:37.289 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T05:00:37.289 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37179.log 2024-09-17T05:00:37.289 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.c.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36979.log.gz 2024-09-17T05:00:37.289 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37219.log 2024-09-17T05:00:37.289 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37179.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T05:00:37.289 INFO:teuthology.orchestra.run.smithi062.stderr: 93.7% 86.5% -- replaced with /var/log/ceph/ceph-client.admin.37179.log.gz 2024-09-17T05:00:37.290 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T05:00:37.290 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T05:00:37.290 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37219.log: gzip -5 --verbose --/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph.log 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37219.log.gz 2024-09-17T05:00:37.290 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-17T05:00:37.290 INFO:teuthology.orchestra.run.smithi062.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-17T05:00:37.290 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-17T05:00:37.290 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T05:00:37.290 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37099.log 2024-09-17T05:00:37.290 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mgr.x.log: 92.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T05:00:37.290 INFO:teuthology.orchestra.run.smithi062.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-17T05:00:37.299 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T05:00:37.299 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37099.log: gzip -5 --verbose -- 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37099.log.gz 2024-09-17T05:00:37.299 INFO:teuthology.orchestra.run.smithi062.stderr: /var/log/ceph/ceph-client.admin.37019.log 2024-09-17T05:00:37.299 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37259.log 2024-09-17T05:00:37.299 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37019.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37019.log.gz 2024-09-17T05:00:37.299 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37059.log 2024-09-17T05:00:37.299 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37259.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37259.log.gz 2024-09-17T05:00:37.299 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-09-17T05:00:37.300 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37059.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37059.log.gz 2024-09-17T05:00:37.331 INFO:teuthology.orchestra.run.smithi043.stderr: 87.5%/var/log/ceph/ceph-client.admin.46674.log: -- replaced with /var/log/ceph/ceph-client.admin.43509.log.gz 2024-09-17T05:00:37.331 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46674.log.gz 2024-09-17T05:00:37.331 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43888.log 2024-09-17T05:00:37.331 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45454.log 2024-09-17T05:00:37.331 INFO:teuthology.orchestra.run.smithi043.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42283.log.gz 2024-09-17T05:00:37.331 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42627.log 2024-09-17T05:00:37.331 INFO:teuthology.orchestra.run.smithi043.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43888.log.gz 2024-09-17T05:00:37.331 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42973.log 2024-09-17T05:00:37.331 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45454.log: /var/log/ceph/ceph-client.admin.42627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36723.log 2024-09-17T05:00:37.331 INFO:teuthology.orchestra.run.smithi043.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45454.log.gz 2024-09-17T05:00:37.331 INFO:teuthology.orchestra.run.smithi043.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42627.log.gz 2024-09-17T05:00:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44236.log 2024-09-17T05:00:37.332 INFO:teuthology.orchestra.run.smithi043.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42973.log.gz 2024-09-17T05:00:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T05:00:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36723.log.gz 2024-09-17T05:00:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.44236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45327.log 2024-09-17T05:00:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43646.log 2024-09-17T05:00:37.332 INFO:teuthology.orchestra.run.smithi043.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44236.log.gz 2024-09-17T05:00:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42976.log 2024-09-17T05:00:37.332 INFO:teuthology.orchestra.run.smithi043.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45327.log.gz 2024-09-17T05:00:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43646.log: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T05:00:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42975.log 2024-09-17T05:00:37.332 INFO:teuthology.orchestra.run.smithi043.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43646.log.gz 2024-09-17T05:00:37.332 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43647.log 2024-09-17T05:00:37.333 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42976.log: /var/log/ceph/ceph-client.admin.42975.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42976.log.gz 2024-09-17T05:00:37.333 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36778.log 2024-09-17T05:00:37.333 INFO:teuthology.orchestra.run.smithi043.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42975.log.gz 2024-09-17T05:00:37.333 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36806.log 2024-09-17T05:00:37.333 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43647.log: /var/log/ceph/ceph-client.admin.36778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43845.log 2024-09-17T05:00:37.333 INFO:teuthology.orchestra.run.smithi043.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43647.log.gz 2024-09-17T05:00:37.333 INFO:teuthology.orchestra.run.smithi043.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.36778.log.gz 2024-09-17T05:00:37.333 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43980.log 2024-09-17T05:00:37.333 INFO:teuthology.orchestra.run.smithi043.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.36806.log.gz 2024-09-17T05:00:37.333 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44371.log 2024-09-17T05:00:37.333 INFO:teuthology.orchestra.run.smithi043.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43845.log.gz 2024-09-17T05:00:37.333 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45897.log 2024-09-17T05:00:37.333 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43980.log: /var/log/ceph/ceph-client.admin.44371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43641.log 2024-09-17T05:00:37.334 INFO:teuthology.orchestra.run.smithi043.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43980.log.gz 2024-09-17T05:00:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42962.log 2024-09-17T05:00:37.334 INFO:teuthology.orchestra.run.smithi043.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45897.log.gz 2024-09-17T05:00:37.334 INFO:teuthology.orchestra.run.smithi043.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44371.log.gz 2024-09-17T05:00:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45001.log 2024-09-17T05:00:37.334 INFO:teuthology.orchestra.run.smithi043.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43641.log.gz 2024-09-17T05:00:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42535.log 2024-09-17T05:00:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42962.log: /var/log/ceph/ceph-client.admin.45001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45085.log 2024-09-17T05:00:37.334 INFO:teuthology.orchestra.run.smithi043.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42962.log.gz 2024-09-17T05:00:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42535.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45001.log.gz 2024-09-17T05:00:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43648.log 2024-09-17T05:00:37.334 INFO:teuthology.orchestra.run.smithi043.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42535.log.gz 2024-09-17T05:00:37.334 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45707.log 2024-09-17T05:00:37.335 INFO:teuthology.orchestra.run.smithi043.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45085.log.gz 2024-09-17T05:00:37.335 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47393.log 2024-09-17T05:00:37.335 INFO:teuthology.orchestra.run.smithi043.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43648.log.gz 2024-09-17T05:00:37.335 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45665.log 2024-09-17T05:00:37.335 INFO:teuthology.orchestra.run.smithi043.stderr: 88.7%/var/log/ceph/ceph-client.admin.47393.log: -- replaced with /var/log/ceph/ceph-client.admin.45707.log.gz 2024-09-17T05:00:37.335 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47393.log.gz 2024-09-17T05:00:37.335 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42972.log 2024-09-17T05:00:37.335 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42577.log 2024-09-17T05:00:37.335 INFO:teuthology.orchestra.run.smithi043.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45665.log.gz 2024-09-17T05:00:37.335 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48012.log 2024-09-17T05:00:37.335 INFO:teuthology.orchestra.run.smithi043.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42972.log.gz 2024-09-17T05:00:37.335 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46973.log 2024-09-17T05:00:37.335 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42577.log: /var/log/ceph/ceph-client.admin.48012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48012.log.gz 2024-09-17T05:00:37.336 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44194.log 2024-09-17T05:00:37.336 INFO:teuthology.orchestra.run.smithi043.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42577.log.gz 2024-09-17T05:00:37.336 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.46973.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-17T05:00:37.336 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.44194.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46973.log.gz 2024-09-17T05:00:37.336 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45412.log 2024-09-17T05:00:37.336 INFO:teuthology.orchestra.run.smithi043.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44194.log.gz 2024-09-17T05:00:37.336 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45580.log 2024-09-17T05:00:37.336 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37172.log 2024-09-17T05:00:37.336 INFO:teuthology.orchestra.run.smithi043.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45412.log.gz 2024-09-17T05:00:37.336 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42974.log 2024-09-17T05:00:37.336 INFO:teuthology.orchestra.run.smithi043.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45580.log.gz 2024-09-17T05:00:37.336 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37338.log 2024-09-17T05:00:37.337 INFO:teuthology.orchestra.run.smithi043.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.37172.log.gz 2024-09-17T05:00:37.337 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43307.log 2024-09-17T05:00:37.337 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42974.log: /var/log/ceph/ceph-client.admin.37338.log: gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42974.log.gz -5 2024-09-17T05:00:37.337 INFO:teuthology.orchestra.run.smithi043.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45939.log 2024-09-17T05:00:37.337 INFO:teuthology.orchestra.run.smithi043.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.37338.log.gz 2024-09-17T05:00:37.337 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44305.log 2024-09-17T05:00:37.337 INFO:teuthology.orchestra.run.smithi043.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.43307.log.gz 2024-09-17T05:00:37.337 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37354.log 2024-09-17T05:00:37.337 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45939.log: /var/log/ceph/ceph-client.admin.44305.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T05:00:37.337 INFO:teuthology.orchestra.run.smithi043.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45939.log.gz 2024-09-17T05:00:37.337 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36610.log 2024-09-17T05:00:37.337 INFO:teuthology.orchestra.run.smithi043.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-17T05:00:37.337 INFO:teuthology.orchestra.run.smithi043.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44305.log.gz 2024-09-17T05:00:37.337 INFO:teuthology.orchestra.run.smithi043.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.37354.log.gz 2024-09-17T05:00:37.338 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43309.log 2024-09-17T05:00:37.338 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37753.log 2024-09-17T05:00:37.338 INFO:teuthology.orchestra.run.smithi043.stderr: 75.4% -- replaced with /var/log/ceph/ceph-client.admin.36610.log.gz 2024-09-17T05:00:37.338 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37141.log 2024-09-17T05:00:37.338 INFO:teuthology.orchestra.run.smithi043.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.43309.log.gz 2024-09-17T05:00:37.338 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46445.log 2024-09-17T05:00:37.338 INFO:teuthology.orchestra.run.smithi043.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37753.log.gz 2024-09-17T05:00:37.338 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46107.log 2024-09-17T05:00:37.338 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37141.log: /var/log/ceph/ceph-client.admin.46445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46445.log.gz 2024-09-17T05:00:37.338 INFO:teuthology.orchestra.run.smithi043.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37141.log.gz 2024-09-17T05:00:37.338 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45169.log 2024-09-17T05:00:37.338 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.46107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41711.log 2024-09-17T05:00:37.338 INFO:teuthology.orchestra.run.smithi043.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46107.log.gz 2024-09-17T05:00:37.339 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45496.log 2024-09-17T05:00:37.339 INFO:teuthology.orchestra.run.smithi043.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45169.log.gz 2024-09-17T05:00:37.339 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.41711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44959.log 2024-09-17T05:00:37.339 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45496.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T05:00:37.339 INFO:teuthology.orchestra.run.smithi043.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41711.log.gz 2024-09-17T05:00:37.339 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.44959.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.45496.log.gz 2024-09-17T05:00:37.339 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36933.log 2024-09-17T05:00:37.339 INFO:teuthology.orchestra.run.smithi043.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44959.log.gz 2024-09-17T05:00:37.339 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41907.log 2024-09-17T05:00:37.339 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47495.log 2024-09-17T05:00:37.339 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36933.log: /var/log/ceph/ceph-client.admin.41907.log: gzip 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36933.log.gz 2024-09-17T05:00:37.339 INFO:teuthology.orchestra.run.smithi043.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43644.log 2024-09-17T05:00:37.339 INFO:teuthology.orchestra.run.smithi043.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41907.log.gz 2024-09-17T05:00:37.339 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.47495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47495.log.gz 2024-09-17T05:00:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-17T05:00:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37367.log 2024-09-17T05:00:37.340 INFO:teuthology.orchestra.run.smithi043.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43644.log.gz 2024-09-17T05:00:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44473.log 2024-09-17T05:00:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45538.log 2024-09-17T05:00:37.340 INFO:teuthology.orchestra.run.smithi043.stderr: 85.9%/var/log/ceph/ceph-client.admin.44473.log: -- replaced with /var/log/ceph/ceph-client.admin.37367.log.gz 2024-09-17T05:00:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47049.log 2024-09-17T05:00:37.340 INFO:teuthology.orchestra.run.smithi043.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44473.log.gz 2024-09-17T05:00:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5/var/log/ceph/ceph-client.admin.45538.log: --verbose -- /var/log/ceph/ceph.log 2024-09-17T05:00:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.47049.log: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45370.log 2024-09-17T05:00:37.340 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45538.log.gz 2024-09-17T05:00:37.340 INFO:teuthology.orchestra.run.smithi043.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47049.log.gz 2024-09-17T05:00:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:gzip/var/log/ceph/ceph.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42409.log 2024-09-17T05:00:37.340 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42155.log 2024-09-17T05:00:37.341 INFO:teuthology.orchestra.run.smithi043.stderr: 83.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T05:00:37.341 INFO:teuthology.orchestra.run.smithi043.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45370.log.gz 2024-09-17T05:00:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47806.log 2024-09-17T05:00:37.341 INFO:teuthology.orchestra.run.smithi043.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42409.log.gz 2024-09-17T05:00:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42155.log: gzip -5 --verbose 86.8% -- replaced with /var/log/ceph/ceph-client.admin.42155.log.gz 2024-09-17T05:00:37.341 INFO:teuthology.orchestra.run.smithi043.stderr: -- /var/log/ceph/ceph-client.admin.36667.log 2024-09-17T05:00:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.47806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47806.log.gz 2024-09-17T05:00:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46507.log 2024-09-17T05:00:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5/var/log/ceph/ceph-client.admin.36667.log: --verbose -- /var/log/ceph/ceph-client.admin.37326.log 2024-09-17T05:00:37.341 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36667.log.gz 2024-09-17T05:00:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.46507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43311.log 2024-09-17T05:00:37.341 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46507.log.gz 2024-09-17T05:00:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:gzip/var/log/ceph/ceph-client.admin.37326.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45622.log 2024-09-17T05:00:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43311.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.37326.log.gz 2024-09-17T05:00:37.342 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43311.log.gz 2024-09-17T05:00:37.342 INFO:teuthology.orchestra.run.smithi043.stderr: -- /var/log/ceph/ceph-client.admin.36987.log 2024-09-17T05:00:37.342 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45622.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45622.log.gz 2024-09-17T05:00:37.342 INFO:teuthology.orchestra.run.smithi043.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43649.log 2024-09-17T05:00:37.342 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37369.log 2024-09-17T05:00:37.342 INFO:teuthology.orchestra.run.smithi043.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36987.log.gz 2024-09-17T05:00:37.342 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43930.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43649.log.gz 2024-09-17T05:00:37.342 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-09-17T05:00:37.342 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37369.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.37369.log.gz 2024-09-17T05:00:37.342 INFO:teuthology.orchestra.run.smithi043.stderr:gzip 93.7% -5 --verbose -- /var/log/ceph/ceph-client.admin.42451.log 2024-09-17T05:00:37.342 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T05:00:37.342 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47704.log 2024-09-17T05:00:37.342 INFO:teuthology.orchestra.run.smithi043.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43930.log.gz 2024-09-17T05:00:37.342 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37163.log 2024-09-17T05:00:37.343 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.47704.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42451.log.gz 2024-09-17T05:00:37.343 INFO:teuthology.orchestra.run.smithi043.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47704.log.gz 2024-09-17T05:00:37.343 INFO:teuthology.orchestra.run.smithi043.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42199.log 2024-09-17T05:00:37.343 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37163.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.37163.log.gz 2024-09-17T05:00:37.343 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42977.log 2024-09-17T05:00:37.343 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37169.log 2024-09-17T05:00:37.343 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42199.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42241.log 2024-09-17T05:00:37.343 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42977.log: -- replaced with /var/log/ceph/ceph-client.admin.42199.log.gz 2024-09-17T05:00:37.343 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46644.log 2024-09-17T05:00:37.343 INFO:teuthology.orchestra.run.smithi043.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42977.log.gz 2024-09-17T05:00:37.343 INFO:teuthology.orchestra.run.smithi043.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.37169.log.gz 2024-09-17T05:00:37.343 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36900.log 2024-09-17T05:00:37.343 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42241.log: gzip/var/log/ceph/ceph-client.admin.46644.log: -5 87.3% --verbose -- /var/log/ceph/ceph-client.admin.45981.log 2024-09-17T05:00:37.343 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42241.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46644.log.gz 2024-09-17T05:00:37.343 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-09-17T05:00:37.344 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42711.log 2024-09-17T05:00:37.344 INFO:teuthology.orchestra.run.smithi043.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36900.log.gz 2024-09-17T05:00:37.344 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45981.log: gzip -5 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45981.log.gz 2024-09-17T05:00:37.344 INFO:teuthology.orchestra.run.smithi043.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37793.log 2024-09-17T05:00:37.344 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38093.log 2024-09-17T05:00:37.344 INFO:teuthology.orchestra.run.smithi043.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42711.log.gz 2024-09-17T05:00:37.344 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46065.log 2024-09-17T05:00:37.344 INFO:teuthology.orchestra.run.smithi043.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.37793.log.gz 2024-09-17T05:00:37.344 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46023.log 2024-09-17T05:00:37.344 INFO:teuthology.orchestra.run.smithi043.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.38093.log.gz 2024-09-17T05:00:37.344 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37143.log 2024-09-17T05:00:37.344 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.46065.log: /var/log/ceph/ceph-client.admin.46023.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46065.log.gz 2024-09-17T05:00:37.344 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36751.log 2024-09-17T05:00:37.345 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45227.log 2024-09-17T05:00:37.345 INFO:teuthology.orchestra.run.smithi043.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46023.log.gz 2024-09-17T05:00:37.345 INFO:teuthology.orchestra.run.smithi043.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.37143.log.gz 2024-09-17T05:00:37.345 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43642.log 2024-09-17T05:00:37.345 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36751.log: gzip/var/log/ceph/ceph-client.admin.45227.log: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.36751.log.gz 2024-09-17T05:00:37.345 INFO:teuthology.orchestra.run.smithi043.stderr: -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-09-17T05:00:37.345 INFO:teuthology.orchestra.run.smithi043.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45227.log.gz 2024-09-17T05:00:37.345 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43642.log: gzip 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43642.log.gz 2024-09-17T05:00:37.345 INFO:teuthology.orchestra.run.smithi043.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37187.log 2024-09-17T05:00:37.345 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36694.log 2024-09-17T05:00:37.345 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37187.log: gzip -5 --verbose 86.4% -- replaced with /var/log/ceph/ceph-client.admin.37187.log.gz 2024-09-17T05:00:37.345 INFO:teuthology.orchestra.run.smithi043.stderr: -- /var/log/ceph/ceph-client.admin.42009.log 2024-09-17T05:00:37.345 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36694.log: 74.5% -- replaced with /var/log/ceph/ceph-client.admin.36694.log.gz 2024-09-17T05:00:37.345 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47091.log 2024-09-17T05:00:37.346 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42367.log 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42009.log.gz 2024-09-17T05:00:37.346 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-09-17T05:00:37.346 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.47091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42753.log 2024-09-17T05:00:37.346 INFO:teuthology.orchestra.run.smithi043.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.47091.log.gz 2024-09-17T05:00:37.346 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42367.log: gzip -5 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42367.log.gz 2024-09-17T05:00:37.346 INFO:teuthology.orchestra.run.smithi043.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42966.log 2024-09-17T05:00:37.346 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42753.log: gzip -5 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42753.log.gz 2024-09-17T05:00:37.346 INFO:teuthology.orchestra.run.smithi043.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37370.log 2024-09-17T05:00:37.346 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42966.log: gzip -5 --verbose -- 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42966.log.gz 2024-09-17T05:00:37.346 INFO:teuthology.orchestra.run.smithi043.stderr: /var/log/ceph/ceph-client.admin.42669.log 2024-09-17T05:00:37.346 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.37370.log: gzip -5 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37370.log.gz 2024-09-17T05:00:37.346 INFO:teuthology.orchestra.run.smithi043.stderr: --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T05:00:37.346 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42669.log: gzip -5 --verbose -- 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42669.log.gz 2024-09-17T05:00:37.346 INFO:teuthology.orchestra.run.smithi043.stderr: /var/log/ceph/ceph-client.admin.46779.log 2024-09-17T05:00:37.347 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43310.log 2024-09-17T05:00:37.347 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.46779.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-17T05:00:37.347 INFO:teuthology.orchestra.run.smithi043.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46779.log.gz 2024-09-17T05:00:37.347 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43310.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30579.log 2024-09-17T05:00:37.347 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mds.c.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43310.log.gz 2024-09-17T05:00:37.347 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.tmp-client.admin.30579.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30579.log.gz 2024-09-17T05:00:37.347 INFO:teuthology.orchestra.run.smithi043.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-09-17T05:00:37.347 INFO:teuthology.orchestra.run.smithi043.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-17T05:00:37.365 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mds.f.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T05:00:37.394 INFO:teuthology.orchestra.run.smithi062.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-09-17T05:00:37.435 INFO:teuthology.orchestra.run.smithi062.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T05:00:37.449 INFO:teuthology.orchestra.run.smithi043.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T05:00:37.455 INFO:teuthology.orchestra.run.smithi043.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T05:00:37.461 INFO:teuthology.orchestra.run.smithi043.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T05:00:37.490 INFO:teuthology.orchestra.run.smithi043.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T05:00:37.500 INFO:teuthology.orchestra.run.smithi062.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T05:00:37.502 INFO:teuthology.orchestra.run.smithi062.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T05:00:37.517 INFO:teuthology.orchestra.run.smithi043.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T05:00:37.519 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-09-17T05:00:37.520 INFO:teuthology.orchestra.run.smithi043.stderr:real 0m0.275s 2024-09-17T05:00:37.520 INFO:teuthology.orchestra.run.smithi043.stderr:user 0m1.066s 2024-09-17T05:00:37.520 INFO:teuthology.orchestra.run.smithi043.stderr:sys 0m0.140s 2024-09-17T05:00:37.524 INFO:teuthology.orchestra.run.smithi062.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T05:00:37.542 INFO:teuthology.orchestra.run.smithi062.stderr: 90.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T05:00:37.575 INFO:teuthology.orchestra.run.smithi062.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T05:00:37.577 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-17T05:00:37.577 INFO:teuthology.orchestra.run.smithi062.stderr:real 0m0.311s 2024-09-17T05:00:37.577 INFO:teuthology.orchestra.run.smithi062.stderr:user 0m1.543s 2024-09-17T05:00:37.577 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m0.080s 2024-09-17T05:00:37.577 INFO:tasks.ceph:Archiving logs... 2024-09-17T05:00:37.578 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908543/remote/smithi043/log 2024-09-17T05:00:37.579 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T05:00:37.844 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908543/remote/smithi062/log 2024-09-17T05:00:37.845 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T05:00:38.058 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph.py", line 2000, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph.py", line 1349, in osd_scrub_pgs stats = manager.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 2464, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 1696, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 1687, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi043 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-09-17T05:00:38.058 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T05:00:38.080 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph.py", line 2000, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph.py", line 1349, in osd_scrub_pgs stats = manager.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 2464, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 1696, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_manager.py", line 1687, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi043 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-09-17T05:00:38.080 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T05:00:38.081 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T05:00:38.083 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T05:00:38.153 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T05:00:38.162 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T05:00:38.162 DEBUG:teuthology.orchestra.run.smithi043:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:00:38.165 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:00:38.178 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-09-17T05:00:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-09-17T05:00:38.183 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T05:00:38.183 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-09-17T05:00:38.183 INFO:teuthology.orchestra.run.smithi062.stdout:^* hv01.front.sepia.ceph.com 3 6 377 50 +1341us[+1339us] +/- 50ms 2024-09-17T05:00:38.183 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 56 +270us[ +268us] +/- 59ms 2024-09-17T05:00:38.183 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 116 -2380us[-2383us] +/- 78ms 2024-09-17T05:00:38.183 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:00:38.185 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T05:00:38.185 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-09-17T05:00:38.185 INFO:teuthology.orchestra.run.smithi043.stdout:^* hv01.front.sepia.ceph.com 3 6 377 52 +1253us[+1253us] +/- 50ms 2024-09-17T05:00:38.185 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 50 +181us[ +181us] +/- 59ms 2024-09-17T05:00:38.185 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 52 -2437us[-2436us] +/- 79ms 2024-09-17T05:00:38.185 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:00:38.185 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T05:00:38.206 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T05:00:38.206 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T05:00:38.256 DEBUG:teuthology.orchestra.run.smithi043:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T05:00:38.326 DEBUG:teuthology.orchestra.run.smithi062:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T05:00:38.387 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T05:00:38.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:00:38.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T05:00:38.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:00:38.443 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T05:00:38.453 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T05:00:38.481 INFO:teuthology.task.internal:Duration was 1990.583345 seconds 2024-09-17T05:00:38.482 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T05:00:38.531 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T05:00:38.531 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T05:00:38.534 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T05:00:38.572 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T05:00:38.573 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T05:00:38.703 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T05:00:38.703 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T05:00:38.704 DEBUG:teuthology.orchestra.run.smithi043:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T05:00:38.764 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-09-17T05:00:38.765 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T05:00:38.806 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T05:00:38.806 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T05:00:38.809 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T05:00:38.872 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T05:00:38.872 DEBUG:teuthology.orchestra.run.smithi043:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T05:00:38.877 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T05:00:39.025 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T05:00:39.035 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T05:00:39.035 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T05:00:39.061 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T05:00:39.086 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T05:00:39.096 DEBUG:teuthology.orchestra.run.smithi043:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:00:39.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:00:39.125 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = core 2024-09-17T05:00:39.149 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-09-17T05:00:39.177 DEBUG:teuthology.orchestra.run.smithi043:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:00:39.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:00:39.194 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:00:39.230 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:00:39.230 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T05:00:39.241 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T05:00:39.242 DEBUG:teuthology.misc:Transferring archived files from smithi043:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908543/remote/smithi043 2024-09-17T05:00:39.242 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T05:00:39.277 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908543/remote/smithi062 2024-09-17T05:00:39.278 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T05:00:39.309 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T05:00:39.309 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T05:00:39.314 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T05:00:39.359 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T05:00:39.370 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T05:00:39.370 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T05:00:39.399 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T05:00:39.399 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T05:00:39.402 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T05:00:39.415 INFO:teuthology.orchestra.run.smithi043.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 05:00 /home/ubuntu/cephtest 2024-09-17T05:00:39.416 INFO:teuthology.orchestra.run.smithi062.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 05:00 /home/ubuntu/cephtest 2024-09-17T05:00:39.417 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T05:00:39.449 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T05:00:39.500 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi043 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-09-17T05:00:39.504 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} duration: 1990.583345413208 failure_reason: 'Command failed on smithi043 with status 124: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status''' flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2024-09-17T05:00:39.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T05:00:39.586 INFO:teuthology.run:FAIL